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DIFFERENT  AIR  FORCE  BASES  AND  DEPOTS,  WHERE  APPROXIMATELY  300  AIR  FORCE 
TECHNICIANS  PERFORMED  ULTRASONIC,  EDDY  CURRENT,  PENETRANT  AND  RADIO- 
GRAPHIC  NONDESTRUCTIVE  INSPECTIONS  (NDI)  ON  THE  SAMPLES.  THE  SAME 
DETAILED  NDI  PROCEDURES  WERE  FOLLOWED  BY  ALL  PARTICIPATING  TECHNICIANS. 
THE  INDIVIDUAL  RESULTS  WERE  RECORDED  AND  ACCUMULATED  IN  TERMS  OF  "FINDS", 
’MISSES"  AND  "FALSE  CALLS"  COMPARED  TO  A PRELIMINARY  KNOWLEDGE  OF 
ACTUAL  FLAW  LOCATIONS.  A DETAILED  TEARDOWN  INSPECTION  OF  THE  SAMPLES 
AT  THE  END  OF  THE  PROGRAM  VERIFIED  AND  REFINED  ACTUAL  FLAW  TABULATIONS. 
RESULTS  WERE  COMPUTERIZED  FOR  DATA  STORAGE  AND  RETRIEVAL  AND  ANALYZED 
FOR  EACH  (NDI)  METHOD  AND  STRUCTURE  SAMPLE  TYPE  TO  PROVIDE  DETECTION 
PROBABILITY  VERSUS  FLAW  SIZE  (POD)  CURVES.  OTHER  ANALYSES  PROVIDED  POD 
CURVES  FOR  YEARS  TRAINING  OR  EXPERIENCE,  AGE,  ETC.  THE  PROGRAM  RESULTS 
INDICATE  THAT  AIR  FORCE  NDI  NEEDS  IMPROVEMENT  IN  SEVERAL  SPECIFIC  AREAS 
IN  ORDER  TO  MEET  EXISTING  REQUIREMENTS  FOR  INSPECTION  OF  AIR  FORCE 
HARDWARE.  SOME  CONCLUSIONS  WERE  DERIVED  CONCERNING  FACTORS  THAT 
APPARENTLY  AFFECT  AIR  FORCE  INSPECTION  RELIABILITY.  RECOMMENDATIONS 
FOR  MAKING  BOTH  SHORT  TERM  AND  LONG  TERM  IMPROVEMENTS  IN  NDI  PRO- 
FICIENCY ARE  PRESENTED. 
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This  Final  Report  was  prepared  in  accordance  with  DI-S-3601A  and  is  submitted  in  compliance 
with  the  following  contractual  requirements:  CDRL  Sequence  Number  A002,  Contract 
F41  608-76- D-A005,  Order  0017;  CDRL  Sequence  Number  002,  Contracf^F41608-77-D-A02l, 
Order  0043;  and  CDRL  Sequence  Number  002,  Contract  F41 608-77-D-AQ21 , Order  0045. 

The  report  covers  all  work  done  under  the  basic  contract  and  the  additional  supplementary 
contracts  during  the  period  July  1974  through  December  1978. 

The  Program  was  administered  by  the  U.  S.  Air  Force  San  Antonio  Air  Logistics  Center, 

Kelly  Air  Force  Base,  Texas,  under  the  direction  of  Mr.  B.  W.  Boisvert,  Chief,  Air  Force 
Program  Section,  MMETP.  The  Lockheed-Georgia  Company,  Marietta,  Georgia,  was  the 
prime  contractor  for  the  Program  with  Mr.  William  H.  Lewis  as  the  Lockheed  Program 
Manager.  Mr.  William  H.  Sproat  was  the  Principal  Engineer  throughout  the  Program  and 
was  assisted  by  Mr.  James  M.  Hamilton  and  Mr.  Joseph  L.  Arnoid  in  the  computerization 
of  data,  Mr.  Carl  E.  Bronn  in  statistical  cnalyses,  and  Mr.  William  M.  Pless  in  procedure 
preparation  and  editorial  review.  Mr.  Bruce  D.  Dodd  was  responsible  for  the  data  acquisition 
portion  of  the  Program,  transposing  the  test  samples  and  associated  hardware  to  each  of  the 
Air  Force  installations  and  coordinating  the  technician  inspections.  Lockheed  hcs  assigned 
this  report  the  number  LG79ER001 1 for  internal  control  purposes. 

The  Contractor  wishes  to  express  appreciation  for  the  hospitality  and  support  received  at  each 
Air  Force  field  and  depot  installation  that  participated  in  the  program  and  for  the  complete 
cooperation,  without  which  the  success  of  the  program  would  not  have  been  possible.  The 
support  and  guidance  from  the  Air  Force  Materials  Laboratory,  in  particular  Mr.  Ken  Shimmin 
and  Mr.  Fred  Mullins,  is  acknowledged  and  sincerely  appreciated. 


ABSTRACT 


The  results  of  a four-year  Air  Force  Logistics  Command  program  to  determine  the  leliability 
of  Air  Force  nondestructive  inspection  capability  are  presented.  The  report  completely 
describes  the  program  - its  objectives,  scope,  planning  and  logistics,  participants,  data 
collection,  analysis,  conclusions  and  recommendations . Actual  aircraft  structural  samples 
containing  fatigue  damage  were  transported  to  21  different  Air  Force  bases  and  depots,  where 
approximately  300  Air  Force  technicians  performed  ultrasonic,  eddy  current,  penetrant  and 
radiographic  nondestructive  inspections  (NDl)  on  the  samples.  The  same  detailed  NDI  pro- 
cedures weie  followed  by  all  participating  technicians.  The  individual  results  were  recorded 
and  accumuiated  in  terms  of  "finds",  "misses"  and  "false  calls"  compared  to  a preliminary 
knowledge  of  octual  flaw  locations.  A detailed  teardown  inspection  of  the  samples  at  the 
end  of  the  program  veiified  and  refined  actual  flaw  tabulations.  Results  were  computerized 
for  data  storage  and  retrieval  and  analyzed  for  each  NDI  method  and  structure  sample  type 
to  provide  detection  probability  versus  flaw  size  (POD)  curves.  Other  analyses  provide  POD 
curves  for  years  training,  experience,  age,  etc.  The  program  results  indicate  that  Air  Force 
NDI  needs  improvement  in  several  specific  areas  in  order  to  meet  existing  requirements  for 
inspection  of  Air  Force  hardware.  Some  conclusions  were  derived  concerning  factors  that 
apparently  affect  Air  Force  inspection  reliability.  Recommendations  for  making  both  short- 
term and  long-term  improvements  in  NDI  proficiency  are  presented. 
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SUMMARY  OF  CONCLUSIONS 


The  conclusions  presented  in  this  report  are  based  on  the  data  obtained  during  the  conduct 
of  this  program  which  used  current  NDI  technology  and  equipment  available  at  participating 
Air  Force  installations.  There  was  no  attempt  to  prevent  marginally  performing  technicians 
nor  equipment  with  minimal  capabilities  from  participating  in  the  program.  Bath  the  tech- 
nicians and  equipment  were  assigned  by  Air  Force  on-site  management  on  an  availability 
basis  irrespective  of  expected  performance.  Therefore,  the  resulting  data  reflect  a possible 
wide  range  of  technician  and  equipment  capabilities. 

The  overall  reliability  of  NDI  performed  by  the  Air  Force  and  evaluated  in  this  program, 
falls  below  that  which  has  been  previously  assumed  by  established  guidelines  such  as 
MIL-A-83444,  "Airplane  Damage  Tolerance  Requirements."  The  mean  piobabilities  of 
detecting  fatigue  crocks  in  built-up  aircraft  structure,  using  typical  maintenance  inspection 
techniques  and  procedures,  are  at  least  25  percent  less  than  the  previously  assumed  values. 

Of  foremost  importance  is  the  realization  that  the  current  90-95  percent  reliability  criteria 
(90  percent  probability  of  detection  at  a 95  percent  level  of  confidence)  cannot  be  attained 
for  any  flaw  size  with  typical  inspection  techniques  applied  by  the  average  technician. 

With  one  exception,  the  NDI  techniques  employed  in  the  program  demonstrated  considerable 
difficulty  achieving  a 50  percent  probability  of  detection  with  95  percent  confidence  for 
1/2-inch  crack  sizes.  However,  the  limited  use  of  more  advanced,  semiautomated  eddy 
current  and  ultrasonic  equipment  (incorporated  late  in  the  program)  indicated  that  the  90-95 
percent  reliability  criteria  may  be  achievable  at  crack  sizes  somewhat  smaller  than  the 
1/2-inch  measured  by  this  program. 

The  average  capability  among  both  field  and  depot  NDI  shops  was  found  to  be  uniform 
(therefore  predictable),  with  the  exception  of  one  installation.  This  aspect  of  uniformity 
is  a strong  point  which  can  be  used  to  advantage  if  changes  are  incorporated  Air  Force-wide 
into  the  NDI  system.  Such  changes  therefore  should  affect  the  NDI  system  uniformly.  In 
addition,  future  representative  measurements  of  Air  Force  NDI  capability  can  be  achieved 
by  using  a smaller  sample  of  installations. 

A distinctly  higher  level  of  flaw  detection  success  was  achieved  at  one  exceptional  in- 
stallation, a depot,  especially  with  the  eddy  current  bolt-hole  method.  This  demonstrated 
that  considerably  better  performance  levels  than  those  generally  exhibited  are  possible. 

The  superior  performance  at  this  one  installation  is  attributed  solely  to  individual  profi- 
ciency. The  attributes  which  produced  the  superior  performance  ond  which  can  serve  as  a 
model  in  efforts  to  upgrade  overall  NDI  performance  are  believed  to  be  the  following: 

I . NDI  operations  were  conducted  within  an  organization  which  is  exclusively 
dedicated  to  nondestructive  inspection. 

. A staff  of  skilled  personnel  was  acquired  by  a selective  process. 

3.  A form  of  certification-recertification  was  performed  at  periodic  intervals. 


XI 


The  major  variation  in  inspection  results  was  found  among  the  individual  technicians  them- 
selves. There  are  vast  differences  in  the  performance  levels  of  individuals,  as  evidenced 
by  comparisons  of  curves  plotted  for  the  upper  ten  percent  of  technicians  with  the  mean 
curves  for  all  technicians.  'The  factors  which  might  be  expected  to  have  a strong  direct 
beaiing  on  individual  NDI  performance,  such  os  formal  education,  technician  age, 
classification,  skill  level,  NO!  experience  and  NDI  training,  were  evaluated  and  found 
to  have  only  minimal  influence  on  performance  levels.  The  primary  source  of  variance 
among  individual  technicians  is  believed  to  be  the  area  of  human  factors,  which  should  be 
furtlrer  investigated. 

With  the  exception  of  the  one  depot  noted,  there  were  no  significant  differences  between 
individual  installations,  nor  between  individual  Commands,  nor  between  field  and  depot 
installations.  Likewise,  there  was  no  significant  difference  observed  between  technicians 
using  different  manufacturer's  equipment . 
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SECTION  I.  BACKGROUND 


Nondestructive  Inspection  (NDI)  has,  over  the  past  ten  years,  evolved  into  a vital  part  of 
the  management  of  aircraft  fleet  maintenance  within  the  Air  Force.  Nondestructive  methods 
of  interrogating  parts  and  assemblies  for  damoge  incurred  through  normal  use,  environmental 
exposure  and  cyclic  fatigue  are  applied  to  both  detect  and  assess  that  damage.  Predictions 
of  the  extent  of  damoge  which  can  be  expected  with  given  aircraft  missions  are  now  being 
made  on  a quantitative  basis  and  NDI  is  charged  with  the  responsibility  of  finding  existing 
flaws.  Both  major  scheduled  fleet  maintenance  at  the  depots  and  routine  maintenance  opera- 
tions at  the  field  level  employ  specific  procedures  to  seek  out  flaws  before  they  cause  major 
failures.  Additionally,  special  inspections  are  performed  in  response  to  unanticipated  domoge 
which  may  appear  on  aircraft  in-service. 

FLAW  DETECTION  CRITERIA 

The  impact  of  NDI  is  felt  in  operations  dealing  with  both  aging  aircraft  and  new  sytems. 

The  diive  to  extend  the  service  life  of  aging  aircraft  beyond  the  originally  planned  use  period 
places  the  burden  of  proving  structural  integrity  upon  NDI.  Newer  systems  are  emerging  with 
critical,  highly  stressed  components  which  ore  more  sensitive  to  flaws  and  therefore  are  re- 
quiring periodic  NDI  to  ensure  structural  integrity  throughout  their  life.  In  both  cases,  old 
and  new  aircraft,  fracture  mechanics  Technology  is  being  applied  to  quantitatively  define 
damage  tolerance  limits  for  given  flaw  sizes  and  to  establish  flaw  growth  rates  under  specific 
service  conditions.  The  capabilities  of  NDI  to  detect  flaws  also  must  be  quantified  to  allow 
fracture  technology  to  become  practical.  As  a first  step,  nondestructive  methods  applied  in 
production  environments  have  been  quantitatively  evaluated  by  several  contractors  in  recent 
airframe  procurement  programs,  but  the  need  still  has  remained  for  evaluation  of  current  in- 
service  NDI  maintenance  capabilities. 

Damoge  tolerance  and  structural  integrity  are  treated  as  the  overall  guiding  concepts  in 
MIL-STD-1  530,  "Aircraft  Structural  Integrity  Program,"  Requirements  center  around  airframe 
design,  design  analysis  and  development  tests,  full-scale  testing,  force  management  data, 
and  the  force  management  itself.  The  possible  existence  of  inherent  flaws  and  the  probability 
of  their  detection  is  implicit  to  all  five  of  these  requirements.  Design  and  development  func- 
tions which  interrelate  with  NDI  are  treated  in  Mll-A-83444,  "Airplane  Damage  Tolerance 
Design  Requirements."  This  specification  asserts  that  flaws  are  inherent  to  any  material  and 
that  designs  must  account  for  them  , The  capabilities  of  NDI  to  detect  flaws  of  specific  di- 
mensions are  assumed  possible  within  the  production  environment  and  any  analyses  which  must 
assume  inherent  flaw  dimensions  smaller  than  the  specified  values  in  MIL-A-83444  must  incur 
a demonstration  of  capabilities  to  detect  those  smaller  flaws.  The  B-l  and  A-10  programs  are 
examples  of  demonstrations  performed  to  satisfy  the  requirements  of  MIL-A-83444. 

In-service  flaw  detectability  assumptions  for  airframes  have  also  been  set  forth  in  MlL-A-83444; 
however,  there  have  been  no  measurements  made  of  actual  capabilities  nor  are  any  demon- 
strations of  in-service  detection  capabilities  required.  A baseline  is  needed  to  establish 
experimentally  derived  values  for  in-service  flaw  detection  probabilities,  much  as  demonstrations 
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in  flic  production  environment  hove  established  a baseline  for  that  condition.  This  program 
lias  filled  that  need  by  acquiring  and  analyzing  Air  Force  field  and  depot  NDI  reliability 
dofci  whi.  » establish  flaw  defection  probabilities  for  a number  of  operating  and  environmental 
parameters.  The  results  are  applicable  for  filling  out  the  spectrum  of  NDI  interrelationships 
colled  for  in  MIL  - STD- 1 530;  the  force  management  data  package  and  the  force  management 
itself . Application  of  the  results  center  around  the  quantif ication  of  flow  detectability  limits, 
inspection  management  within  the  maintenance  environment,  and  identification  of  areas  for 
improvement . 

NDI  RELIABILITY  OBJECTIVES 

Tlx*  overriding  objective  of  the  program  is  to  determine  the  existing  capability  of  NDI  to  detect 
flaws  under  field  and  depot  conditions.  These  capabilities  are  graphically  displayed  as 
detection  probabilities  relative  to  flaw  size  for  specific  inspection  conditions.  This  information 
when  coupled  with  appropriate  fracture  mechanics  data  such  as  crack  growth  rates,  allows  for 
quantitative  determinations  of  maintenance  inspection  intervals.  Additionally,  the  unique, 
quantif  it'd  NDI  reliability  data  from  this  program  allow  for  analyses  which  point  out  areas  for 
improvement  in  operations  through  efficient  selection  of  NDI  methods,  and  the  optimization 
of  human  factors  in  managing  NDI  personnel.  Significant  cost  savings  can  be  realized  by 
applying  quantitatively  established  NDI  data  in  the  maintenance  cycle  to  prevent  failures  and 
unnecessary  down-time  of  aircraft.  Additionally,  NDI  functions  which  are  presently  specified 
but  have  a very  low  probability  of  accomplishing  their  objectives,  as  viewed  in  the  light  of 
tills  effort,  can  be  eliminated  or  changed. 

Tlx?  process  of  acquiring  NDI  reliability  data  has  been  primarily  centered  around  the  perform- 
ance of  flaw  search  tasks  on  a number  of  samples  with  fatigue  cracks.  A sufficient  number  of 
samples  and/or  flaw  detection  attempts  are  mode  to  establish  a statistically  adequate  volume 
of  data  for  each  selected  set  of  conditions.  The  philosophy  of  most  test  plans  is  either  to 
select  a target  flaw  size  and  proceed  to  determine  whether  that  size  can  be  reliably  detected, 
or  to  measure  detection  probabilities  for  a spectrum  of  flaw  sizes  without  a commitment  to  a 
detection  probability  at  a given  flaw  size.  The  B-l  and  A-10  demonstration  programs  were 
designed  to  provide  evidence  that  a given  flaw  size  could  be  detected  with  a high  degree  of 
certainty.  A 90%  probability  of  detection  at  a 95%  level  of  confidence  has  been  established 
os  the  criterion  for  that  high  degree  of  certainty.  The  90/95  values  arose  from  "B"  values 
established  for  basic  materials  property  characterizations  with  test  data  inherently  containing 
scatter.  The  generation  of  NDI  reliability  data  with  a spectrum  of  fatigue  crack  lengths,  on 
the  other  hand,  has  been  accomplished  for  research  and  technology  purposes  as  NDI  inputs  to 
design,  fabrication,  and  maintenance  planning  tasks. 

PRIOR  RELIABILITY  EFFORTS 
» 

Historically,  NDI  reliability  work  in  the  aerospace  industry  and  the  Air  Force  began  wdth  a 
recognized  neecLfor  such  data  to  interplay  with  evolving  fracture  mechanics  analyses  in  the 
late  1960's.  The  first  detailed  investigation  was  conducted  by  Packman,  et.al.,  (Reference  1) 
for  the  Air  Force  Materials  Laboratory.  The  objective  was  to  measure  flaw  detectability  for 
aircraft  production  parts.  A number  of  programs  sponsored  by  both  the  Air  Force  and  NASA 
have  been  performed  since  that  time,  with  a diversity  cf  specimen  configurations  and  flaw  types 
employed  in  the  flaw  detection  tasks.  A comprehensive  repository  of  information 
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acquired  from  many  of  these  programs  was  developed  and  processed  for  NASA  by  Yee,  et.al., 
(Reference  ?)  in  1976.  Recent  data  contributions  for  the  Air  Force  have  been  developed 
by  lord  (Reference  3)  and  Southwoith,  et.al.  (Reference  4),  and  for  NASA  by  Rummel,  et.ol., 
(Reference  5).  A program  to  examine  the  diverse  results  from  a number  of  studies  which 
provided  nondestructive  flaw  detection  reliability  data  and  to  devise  a model  to  translate  or 
interrelate  those  data  was  conducted  for  the  Air  Force  by  Chang,  et.al.,  in  1976,  (Reference 
6). 

Initial  work  on  assessing  NDI  reliability  on  built-up  structure,  as  contrasted  to  production 
part  configurations,  was  conducted  as  internal  research  at  the  lockheed-Georgia  Company 
beginning  in  1971;  Project  No.  71R2320.  Following  the  failure  of  an  engine  pylon  on  a 
C-5A,  an  internal  study  was  also  conducted  to  determine  in-service  flaw  detection  probabili- 
ties for  a pylon  fruss-to-shroud  assembly  with  fatigue  cracks  originating  at  fastener  sites  in 
the  truss  itself.  The  results  of  this  study  are  presented  in  a report  by  Sproat  (Reference  7), 
which  showed  that  fatigue  crack  detection  probabilities  in  assembled  structure  would  be 
generally  lower  than  for  comparable  flaws  in  parts  or  specimens.  Full-scale  assessment  af 
NDI  capabilities  from  an  in-service  maintenance  standpoint  was  performed  for  internal 
Lockheed  research  tasks  on  C-130  center  wing  boxes  which  were  removed  from  service, 
fatigue  cycled  to  induce  damage,  and  tested  for  residual  strength.  Results  of  this  work  v..'“ 
presented  in  a Lockheed  report  by  Sproat  and  Dodd  (Reference  8).  Two  general  conclusions 
were  found  at  that  time: 

1 . Fatigue  crack  detection  probability  on  structure,  by  single  applications 
of  ultrasonics  and  eddy-current  NDI  techniques,  is  significantly  lower 
than  that  normally  assumed  for  most  fail-safe  and  monolithic  slow  crack 
growth  airframe  designs. 

2.  Redundant  inspections  using  multiple  applications  of  one  technique  or  a 
mixture  of  techniques  can  be  employed  to  yield  the  detection  levels 
required  for  most  slow  crack  growth  and  fail-safe  designs  if  the  inspection 
conditions  were  similar  to  those  experienced  in  this  independent  research 
program.  The  influences  of  other  factors  on  detection  reliability  were  not 
evaluated . 

The  experimental  approach  Vo  provide  data  for  answering  the  numerous  questions  regarding 
the  nondestructive  maintenance  Inspection  processes  were  formulated  after  careful  analysis 
of  tire  results  of  the  above  two  efforts. 
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SECTION  II.  PROGRAM  PLANNING 


The  Air  Force  Logistics  Command's  Materia!  Management  organization  is  charged  with  the 
responsibility  to  oversee  NDI  operations  from  a technical  standpoint,  in  both  depot  and 
field  locations.  Increasing  demands  for  the  use  of  NDI  in  on-going  maintenance  functions, 
coupled  with  the  drive  to  employ  ND!  as  a functional  tool  within  the  scope  of  MIL-A-83444 
philosophy,  brought  about  the  need  to  quantify  in-service  capabilities.  With  the  recognized 
need  and  technical  responsibility,  the  AFLC  proceeded  to  establish  a three-phase  effort  to 
measure  NDI  capabilities  on-site  within  the  field  and  depot  facilities.  A statement  of  work 
was  defined  in  May  1974  which  established  technical  objectives  for;  1)  detailed  planning, 

2)  implementation  of  data  acquisition,  and  3)  flaw  size  confirmation/ data  analysis  phases  of 
a comprehensive  program.  The  Planning  phase  commenced  in  June  1974  with  the  rudiments 
of  a detailed  experimental  approach  outlined  in  the  "Phase  I Mid-Term  Report",  August 
1974  (Reference  9). 

This  mid-term  report  during  the  Planning  phase  was  intended  to  allow  for  a critical  review 
of:  (1)  the  types  of  specimens  (structure)  and  NDI  techniques  under  consideration,  (2)  the 
program  constraints  and  technical  limitations,  and  (3)  the  design  of  a detailed  test  plan  to 
allow  the  statistical  formulation  of  technically  valid  conclusions. 

FLAWED  STRUCTURE 

The  structural  samples  or  specimens  recommended  at  that  time  were  identified  as  Type  A, 
C-130  center  wing  box  section  with  surface  fatigue  cracks  radiating  from  fastener  sites; 

Type  B,  C-iov  center  wing  box  plank  segments  with  surface  fatigue  cracks  like  Type  A; 
and  Type  C,  titanium  straps  with  through-f he-thickness  edge  fatigue  cracks.  Types  A and  B 
were  derived  from  structure  which  had  undergone  in-service  fatigue  damage,  extended  fatigue 
damage  in  a test  jig  and  failed  under  a static  load  applied  to  determine  residual  strength. 
Documented  test  history  and  flaw  data  on  these  items  are  presented  in  Reference  10.  These 
items  also  were  the  structure  samples  used  in  the  independent  research  work  described  in 
Reference  8.  Type  C structure  samples  were  those  used  in  the  C-5A  pylon  aft  truss  NDI 
evaluation  effort  described  in  Reference  7.  The  parameters  used  in  generating  fatigue  cracks 
in  these  samples  are  documented  in  Reference  11  . Photos  of  these  structure  samples  are  pre- 
sented in  Figures  3-4  through  3-9,  and  complete  descriptions  are  provided  in  Section  III  of 
this  report. 

ORIGINAL  CONSTRAINTS 


Program  constraints,  as  viewed  at  that  time  were  primarily  keyed  to  the  availability  of  suit- 
able structure  with  an  adequate  number  of  flaws  of  varying  sizes.  To  establish  curves  of  flaw 
detection  probabilities  with  enough  data  for  statistically  sound  evidence,  the  flaw  population 
and  the  number  of  NDI  attempts  should  be  sufficiently  large.  The  Phase  I Mid-Term  report 
proposed  the  following  data  acquisition  approach: 
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An  anticipated  elapsed  time  of  5 to  8 hours  per  individual  per  NDI  tech- 
nique on  A and  C specimen  types.  Two  inspectors  could  simultaneously 
inteuogate  spocimen  Types  A and  C while  others  perform  on  specimen 
Type  R.  Tire  following  table  (Figure  2-1)  denotes  the  assignment  of  six 
inspectors  for  a 12-day  period  of  work  on  specimens  following  an  orlen- 
totion  period  of  1 day. 

Tire  total  elapsed  time  per  location  (with  six  Inspectors)  required  for  set- 
up, data  acquisition,  and  tear-down  was  anticipated  to  be  15  working 
days . 

Tire  technical  imitations  were  primarily  involved  with  the  magnitude  of 
fire  data  sample.  The  specimen  Type  A contained  17  fatigue  cracks  in 
tire  0.1"  long  size  category,  5 cracks  in  the  0.2"  long  size  category, 
etc . If  six  individuals  took  part  in  the  effort  at  each  location,  the  crack 
sample  in  the  0.1"  long  category  for  specimen  Type  A would  be  6 x 17  = 
102,  for  example.  A sample  size  of  30  would  be  sufficient  to  attach 
statistical  significance.  The  available  cracks  In  the  0.1"  long  category 
for  the  Type  A specimen  was  therefore  quite  adequate.  The  available 
cracks  in  the  0.3"  through  0.6"  category  were,  however,  insufficient  to 
establish  statistical  significance  to  data  in  those  size  categories  for  indivi- 
dual locations.  Pooling  data  from  several  locations  would  allow  for 
statistical  significance  in  treating  results  among  groups  (locations). 

The  available  fatigue  crack  population  for  specimen  Type  B was  adequate 
to  attach  additional  significance  within  groups  for  each  flaw  size  category 
through  0.6"  at  each  location  or  base.  Specimen  Type  C allowed  for 
flexibility  in  the  population  for  sites  ranging  from  0,05"  to  0.30"  . Statis- 
tical significance  for  results  on  flaw  size  ranges  within  groups  would  be 
possible  for  the  Type  C specimens. 

The  controlled  and  uncontrolled  variables,  as  technical  limits,  were  addi- 
tional program  constraints.  The  controlled  variables  were: 

a.  the  NDI  methods  (eddy  current,  radiography,  ultrasonics,  and 
penetrant) 

b.  use  or  omission  of  detailed  procedures  and  calibration  standards 

c.  specimen  configuration 

(1)  position  (overhead,  vertical,  etc.) 

(2)  access 

(3)  flaw  size  population 

(4)  flaw  density  (ratio  of  flawed  to  unflawed  area) 
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(5)  specimen  complexity  (shape  and  number  of  elements) 

(6)  specimen  randomness  (cues  for  probable  defect  location) 

(7)  flaw  character 

The  uncontrolled  variables  included: 

a.  environment 

b.  human  physiological  response 

c.  attitude  (psychological) 

d.  inspection  pace  (with  upper  limit) 

e.  disruptive  factors 

f.  personnel  and  equipment 

Some  of  the  variables  were  quantitative  while  others  such  as  the  inspector's  attitude  were 
not,  thus  introducing  unknowns  into  the  results.  Approaches  used  to  minimize  the  uncertainty 
of  the  test  results  are  described  in  the  final  detailed  Test  Plan  (Reference  10). 

ORIGINAL  TEST  PLAN 

The  original  program,  as  envisioned  in  August  1974,  was  designed  to  answer  the  following 

questions: 


1 . What  is  the  relative  effectiveness  of  conventional  NDI  methods  applied  to 
structure,  i.e.,  flaw  detection  probabilities  relative  to  radiographic, 
ultrasonic,  eddy  current,  and  penetrant  inspections? 

2.  What  is  the  Air  Force  field  and  depot  capability  in  NDI?  More  specifically, 
what  are  the  probabilities  of  flaw  defection  in  structure  by  Air  Force  per- 
sonnel and  equipment? 

3.  What  differences  exist  in  NDI  capabilities  from  base  to  base,  if  any? 

4.  How  effective  are  7 Level  Air  Force  NDI  personnel  in  devising  NDI 
procedures?  - 

5.  What  is  the  range  of  individual  capabilities  among  all  groups  (all  bases)  and 
within  each  group  (base)?  In  other  words,  what  is  the  scatter  factor  at- 
tributed to  individual  differences  and  to  differences  between  bases? 

The  answers  to  these  questions  were  to  be  provided  by  statistical  analysis  of  the  data  using 
flaw  detection  results  as  a measure  of  performance.  The  nucleus  of  the  data  presentations 
were  planned  to  be  graphic  plots  of  detection  probabilities  relative  to  flow  length;  with 
confidence  limits  determined  by  assuming  a Gaussian  scatter  of  points.  Tests  for  significance 
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o!  variables  were  to  be  performed  by  a covariance  technique  which  accommodates  missing 
data  in  a matrix  of  voriabie  combinations.  Details  on  the  development  of  the  graphic  plots 
and  the  analysis  of  covariance  are  provided  in  Section  IX  and  in  the  Test  Plan  (Reference  10). 

STEERING  COMMITTEE  GUIDANCE 

On  12-13  November  1974,  a Steering  Committee,  consisting  of  some  of  the  most  knowledge- 
able experts  in  this  area  of  technology  from  both  government  and  industry,  was  assembled  by 
the  Air  Force  to  critically  review  the  original  Test  Plan  which  was  developed  for  the  Phase  I 
Mid-Term  report.  The  following  basic  recommendations  were  made  by  that  Committee: 

1 . Increase  the  total  number  of  flaws  and  types  of  structure . 

2.  Provide  a more  comprehensive  scope  of  data  acquisition  through  the  Air  Force. 

3.  Prepare  a briefing  to  introduce  the  program  content  and  scope  to  the  Air  Force 
Logistics  Command  Management  and  Engineering  personnel . 

4.  Prepare  a detailed  Test  Plan  with  updated  content  on  structure  samples  and  base 
visits  for  Steering  Committee  review  by  March  1975. 

5.  Delete  the  option  for  on-site  NDI  procedures  development. 

6.  Develop  an  oi  ientation  briefing  to  familiarize  participants  with  the  purpose, 
scope  and  mechanics  of  the  program. 

The  first  item  above  impacted  the  total  effort  by  increasing  the  total  number  of  structure 
samples.  No  additional  C-130  wing  boxes  with  sufficient  quantities  of  fatigue  «,  racks  were 
readily  available.  Additional  samples  were  acquired  from  the  Air  Force  through  the  efforts 
of  Capt.  W.  Lundy  ot  Oklahoma  City  ALC  and  A.  Rogel  at  Sacramento  ALC  . A segment 
of  a KC-135  canter  wing  lower  plank  with  suspected  fatigue  cracks  at  fastener  sites  and 
nine  (9)  pieces  of  F-104  forged  wing  fittings  with  suspected  fotigue  crocks  ot  fastener  sites 
were  obtained.  Automatic  eddy  current  bolt-hole  NDI  strip  chart  records  accompanied  the 
F-104  wing  fittings.  The  search  for  suitable  pieces  of  the  C-5A  fotigue  article  X998  wing 
assembly  was  not  fruitful.*  Another  C-5A  test  article,  however,  was  located  and  found 
acceptable:  a C-5A  configured  wing  spar  web-to-cap  box  beam  test  article.  A detailed 
report  for  fatigue  damage  identification  is  contained  in  Reference  11  . The  KC-135  sample 
obtained  was  identified  as  Type  D,  the  F-104  fittings  as  Type  E,  and  the  C-5A  box  beam 
specimen  as  Type  F . 


It  became  clearly  evident,  in  attempts  to  expand  the  structure  somple  size  for  the  program, 
that  representative  fatigue  damaged  structure  with  a suitable  population  of  flows  ranging 
over  a spectrum  of  lengths  is  very  difficult  to  obtain.  Therefore,  the  bulk  of  the  structure 
samples  used  were  those  which  were  recommended  in  the  Phase  I Mid-Term  Report  on  this 
program . 
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rl*’  «ro[x-  o!  <Jnta  acquisition,  Item  2,  wos  expanded  from  an  original  plan  to  visit  one  bos* 
in  one li  majt’i  command;  Military  Airlift  Command,  Tactical  Air  Command,  Strategic  Air 
Command  and  Air  Training  Command,  to  four  bases  each.  A full  spectrum  of  capabilities 
of  the  field  level,  plus  visits  to  the  five  depots,  was  expected  to  provide  a more  representa- 
tive measure  of  Air  Force  capabilities  in  NDI.  The  remaining  action  items  were  completed 
as  scheduled,  with  the  final  Detailed  Test  Plan  submitted  for  review  by  the  Steering  Committee 
in  March  1975.  The  final  approved  version  of  this  document  was  published  in  July  1975 
(Reference  101. 
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SECTION  III.  PROGRAM  TECHNICAL  APPROACH 


The  primary  approach  to  the  progrcxn  as  approved  in  the  final  Test  Plan  (Reference  10)  is 
as  follows: 

a.  Select  representative  structu  e with  known  defects  which  can  be  routinely 
inspected  by  existing  NDI  Air  Force  depot  and  field  installations.  The 
numbers  and  sizes  of  defects  shall  be  adequate  for  statistical  analyses  of  re- 
sults. 

b.  Subject  the  structure  to  routine  NDI  at  a full  spectrum  of  Air  Force  depot  and 
field  installations  with  a representative  sample  of  NDI  technicians  and  inspec- 
tion conditions. 

c.  Examine  the  results  of  the  NDI  in  terms  of  flaw  detection  probabilities  as  a 
function  of  flaw  size  on  a statistical  basis.  The  major  evaluation  parameters 
shall  be  (1)  technician  skill  level,  (2)  depot  versus  base  capabilities,  (3)  NDI 
method  used,  and  (4)  type  of  structure.  Analyses  shall  be  performed  to  deter- 
mine the  influence  of  these  parameters  on  flaw  detection  probabilities. 

The  Detailed  Test  Plan  was  designed  to  provide  the  details  to  be  used  in  acquiring  an*' 
alyzing  the  NDI  data.  It  was  the  end  result  of  the  program  planning  which  included 
following  tasks: 

a.  Design,  fabricate,  and/or  purchase  hardware  and  support  equipment  to  trans- 
port and  maintain  field  operations  required  for  on-site  evaluations  of  NDI  at 
selected  Air  Force  installations. 

b.  Establish  a complete  program  of  participant  orientation,  procedures  for  perform- 
ing the  NDI,  and  clear  instructions  for  reporting  defect  finds. 

c.  Devise  a scheme  for  transferring  raw  data  on  NDI  test  results,  NDI  personnel 
profiles,  base  NDI  equipment  evaluation,  environmental  factors  surrounding 
tests  at  the  Air  Force  bases,  individual  equipment  settings  used  by  each  tech- 
nician on  each  NDI  performed,  and  daily  log  entries  at  each  base. 

d.  Develop  a method  of  data  analysis  to  statistically  evaluate  NDI  effectiveness 

in  terms  of  detection  probabilities  as  a function  of  flow  size  at  50%,  90%,  95%, 
and  99%  confidence  levels.  The  major  parameters  to  be  addressed  in  this 
evaluation  are:  (1)  field  versus  depot  locations,  (2)  training  and  proficiency 
of  NDI  personnel,  (3)  the  NDI  methods  employed,  and  (4)  the  type  of  structure 
used  in  the  test. 


e.  Devise  procedures  to  set  up  structure  samples  into  typical  configurations  en- 
countered for  NDI  at  the  depot  and  field  installations  as  well  as  structure 
sample  cleaning  and  processing  for  re-use. 
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f.  Develop  means  of  reporting  the  findings  to  facilitate  Air  Force  planning 
of  (1)  inspection  scheduling,  (2)  use  of  equipment,  (3)  training  and  place- 
ment of  NDI  personnel,  and  (4)  damage-tolerant  design  and  risk  analysis. 

The  approach  took  full  advantage  of  using  actual  aircraft  structure*  with  fatigue  cracks  as 
samples  for  NDI . These  structure  samples  were  presented  to  the  NDI  technicians  in  settings 
which  very  closely  represented  those  encountered  in  routine  field  and  depot  operations. 

Some  samples  were  placed  in  an  overhead  position  to  simulate  NDI  on  a wing  lower  surface. 
Other  configurations  included  face-up  positions  and  vertical-plane  positions,  typical  of  a 
full  range  of  structure. 

Tlx?  NDI  technicians,  after  an  orientation  briefing,  were  assigned  specific  NDI  tasks  on 
tliese  samples  as  called  out  in  the  procedures  designed  for  each  task.  Results  of  this  NDI 
were  recorded  and  sent  to  Lockheed,  along  with  accompanying  parametric  data.  A cumula- 
tive analysis  of  data,  by  regression  and  covariance,  were  performed  as  the  data  became 
available.  Both  raw  data  and  analyzed  results  were  provided  to  the  AFLC  as  soon  as  avail- 
able . 

I 

GENERAL  OVERVIEW 


Tradeoffs  among  cost,  availability  of  suitable  structure,  and  selection  of  the  number  of  test 
sites  and  participants  were  examined.  Ideally,  each  factor  which  contributes  to  the  results 
should  be  controlled  independently  on  a strictly  quantitative  basis.  It  was  also  desirable  to 
acquire  a large  number,  80  to  100  points,  of  data  under  each  controlled  set  of  conditions. 
The  study  of  tradeoffs  showed  that  practical  considerations  provided  approximations  to  the 
best  case.  Therefore,  the  following  plan  was  devised: 

a.  Six  different  types  of  representative  aircraft  structure  to  be  inspected  at  each 
installation . A description  of  each  and  the  associated  NDI  to  be  performed 
is  compiled  in  Figure  3-1  . Figure  3-2  lists  the  originally  estimated  length  of 
flaws  in  each  structure.  The  aggregate  length  distribution  is  provided  in  Figure 
3-3. 

b.  An  average  of  15  participants  at  each  Air  Logistics  Center  and  6 participants  at 
each  field  level  base  within  the  Commands  to  be  visited  were  desired  depending 
on  availability . 

c.  Four  major  test  variables  will  be  controlled  or  directly  observed:  (1)  field  or 
depot  location,  (2)  NDI  method,  (3)  proficiency  of  inspectors,  and  (4)  type  of 
structure  with  accompanying  flaw  sizes.  The  following  ancillary  factors  will  be 
recorded:  (5)  NDI  equipment  condition,  (6)  environment,  and  (7)  position  of 
structure  (overhead  and  below  for  eddy-current  surface  scans). 


*The  size  and  number  of  flaws  cataloged  for  data  acquisition  was  originally  based  on  NDI 
and  close  visual  inspection  on  assembled  structure.  The  actual  features  and  total  content 
of  flaws  in  the  structure  samples  are  provided  in  the  teordown  data;  Section  VII. 
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Figure  3-1  . Combinations  of  Specimens  and  Inspection  Methods 
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Figure  3-2,  Flaws  in  Structure  Samples  Identified  by  Numoer 
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Figure  3-2.  Flaws  in  Structure  Samples  Identified  by  Number  (continued) 
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Figure  3-2.  Flaws  in  Structure  Samples  Identified  by  Number  (continued) 
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The  combination  of  all  flaw  defection  opportunities  ot  all  bases  was  expected  to  yield 
approx imately  46,000  individual  measurements.  T lie  implementation  of  these  measurements 
is  addressed  in  subsequent  sections  of  this  report. 

SI  KUCTURE  SAMPl E S 

The  six  types  of  representative  structure  compiled  in  Figure  3-1  are  shown  in  Figures  3-4 
through  3-9.  They  are  as  follows: 


Sample  Type 


Description 


A C-130  center  wing  box,  intact  5-Fc>ot  segment 

B C-130  center  wing  box  lower-surface  segments 

C Simulated  titanium  wing  risers  mounted  inside  Sample  A 

D Two  sections  of  KC-135  center  wing  lower  plank 

E F-104  wing  fitting  segments 

F C-5  wing  spar  cap/web  test  assembly  (box  beam) 


Type  A Structure 


The  intact  segment  of  a C~'30  wing  box  contains  known  fatigue  cracks  in  the  lower  surface. 
Typically,  chordwise  cracks  are  located  at  fastener  sites,  cutouts  and  drain  holes.  The  wing 
box  had  received  service  induced  fatigue  damage,  was  removed  from  service,  and  c cli~ 
cally  loaded  in  a tesi  jig  to  further  induce  domoge  prior  to  residual  strength  testing.  The 
lov/er  surface  was  stripped  of  paint  for  visual  crack  detection  one  measurement  during  tests. 
After  conclusion  of  the  residual  strength  test,  the  structure  was  employed  as  a test  specimen 
at  Lockheed  for  internal  nondestructive  inspection  reliability  programs,  A suiface  finish  was 
reapplied  in  the  form  of  an  epoxy  primer  and  a single  coat  of  polyurethane  paint.  The  Type 
A structure  was  mounted  on  a dolly  with  the  lower  surface  facing  upward  for  NDI  accessi- 
bility in  this  effoit, 


Type  B Structure 

Twelve  segments  a C-130  center  wing  lower  surface  comprise  the  Type  B items.  The  history 
of  these  items  is  identical  to  the  Type  A structure  and  they  hove  been  flame  cut  for  removal 
from  the  parent  structure.  Conductivity  readings  were  taken  on  suspected  heat  damaged  areas 
to  define  the  extent  of  any  damage.  The  edges  were  subsequently  trimmed  from  the  segments 
as  required  to  allow  only  undomoged  material  to  remain,  fatigue  and  residual  strength  load 
histories  on  Types  A and  B structure  are  available  in  lockbeed-Georgia  Report  ER  1178. 
"C-130,  Results  of  Center  Wing  Residual  Strength  ond  Crack  Propagation  Test  Programs." 

Type  C Structure 

These  were  edge-fatigue-crocked  elements  which  simulated  a portion  of  the  C-5A  pylon  aft 
trusses.  Both  aluminum  and  titanium  elements  were  produced  in  1972  to  assess  C-5A  pylon 
inspection  reliability.  Fatigue  loads  on  these  items  are  recorded  in  Lockheed  Laboratory 
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Date  Records  A364880-A364882 , It  was  planned  to  use  aluminum  elements  in  this  program, 
but  difficulties  with  obtaining  consistent  penetrant  indications  eliminated  further  consideration 
of  their  use.  The  inconsistent  penetrant  indications  were  attributed  to  a build  up  of  oxidation 
in  the  tight  fatigue  cracks  to  the  point  of  excluding  the  penetrant  in  some  cases.  This  effect 
was  not  observed  with  the  titanium  elements  in  over  fifty  (50)  penetrant  inspection  trials  prior 
to  including  them  in  this  program. 

These  elements  were  nested  into  an  open  end  of  the  Type  A structure  for  inspection  to  simu- 
late internal  skin  risers.  Removal  and  reinstallations  for  repeated  penetrant  washout  between 
penetrant  NDI  applications  were  possible  with  this  arrangement. 

Type  D Structure 

This  item  was  two  sections  of  KC-135  center  wing  lower  surface  with  fatigue  cracks  at 
fastener  sites.  The  finish  had  been  stripped  and  surfaces  coustic  etched  when  received  at 
Lockheed.  It  was  subsequently  coated  with  a corrosion  inhibiting  primer. 

Type  E Structure 

These  items  were  bore  segments  of  F - 1 04  wing  fittings  with  service-induced  fatigue  cracks 
at  fastener  holes.  The  segments  were  attached  to  cover  plates  to  provide  a layered  stack-up 
typical  of  multi-element  joints. 

Type  F Structure 

This  structure  was  composed  of  a box  beam  test  specimen  designed  to  represent  the  C-5A 
wing  mid-beam  lower  spar  cap-to-web  assembly  joints  and  mid-beam  web-to-stiffener 
attachments.  The  box  beam  had  been  fatigue  tested  to  evaluate  three  fastener  systems  by 
loading  for  147,000  cyclic  test  hours.  Fatigue  cracks  were  generated  at  some  fastener 
sites.  This  structure  was  mounted  on  a dolly  for  handling.  The  fatigue  history  of  the  box 
beam  is  described  in  Lockheed  Report  LG74ER0Q22, 

PROCEDURES 


Complete  NDI  procedures  were  formulated  in  the  -36  Tech  Order  format  per  MIL-M-38780A 
for  each  NDI  method  os  applied  to  each  structure  type.  The  procedures  included  the 
necessary  operating  parameters  and  equipment  calibration  details.  A validation  run  on  each 
procedure  was  conducted  at  Lockheed  to  ensure  compatibility  with  the  program  objectives 
and  realistic  NDI  operating  practices  at  the  field  and  depot.  The  entiro  procedures  for  this 
effort  are  provided  in  the  Test  Plan  (Reference  10). 

NDI  EQUIPMENT 

Plans  were  to  use  the  existing  case  NDI  equipment  at  each  installation.  This  was  to  provide 
an  indication  of  equipment  condition  and  its  affect  on  total  NDI  reliability  wherever  possible. 
Checks  on  the  condition  and  status  of  equipment  were  handled  as  part  of  the  essential  data  to 
be  compiled  at  Lockheed.  Calibration  standards  for  ultrasonic  and  eddy  current  procedures 
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wore  fuirm^ed.  Radiogrophy  was  characterised  by  a step  wedge  which  was  x-rayed  at  »wo 
exposures  lo  develop  log  relative  exposure  curves  for  the  particular  equipment.  Backup 
ultrasonic,  eddy  current,  and  penetrant  equipment  wns  maintained  in  the  transport  trailer 
for  cases  where  no  equipment  was  locally  available  to  dedicate  to  this  effort. 

FIELD  ANP  DEPOT  DATA  ACQUISITION 

Tlx*  structme  samples  were  transported  to  the  solected  Air  Force  installations  in  a utility 
trailer  specifically  built  for  this  purpose.  The  trailer  also  served  as  an  object  on  which  to 
mount  Type  B stiucture  to  perform  radiographic  and  eddy  current  NDI . The  frailer  and  tow 
vehicle  ate  depicted  in  Figure  3-10.  A pickup  truck  was  used  for  both  transportation  of 
the  Lockheed  engineer  (who  remained  with  the  program  throughout  to  provide  overoll 
coordination  and  direction)  and  trailer  towing  to  tlx?  various  locations. 

On  arrival  of  each  base,  participants  were  selected  at  random,  given  an  orientation  brief- 
ing and  assigned  the  NDI  tasks.  Data  from  the  NDI  tasks  (structure  sample  inspections) 
and  accompanying  evaluations  performed  by  the  Lockheed  engineer  were  then  compiled  and 
sent  to  Lockheed.  The  structure  samples  subsequently  were  loaded  and  operations  moved  to 
tlx;  next  paiticipating  base.  The  following  narrative  is  presented  to  describe  each  of  the 
data  acquisition  steps  in  detail. 

1 . Selection  of  Participants 

A representative  cross-section  of  NDI  technicians  were  selected  whenever  possible 
with  regard  to  training,  skill  level,  and  background.  However,  some  bases  had  limited 
numbers  of  personnel,  and  the  alternative  was  to  obtain  data  in  sufficient  quantities  at 
each  base  by  requesting  participation  from  all  available  NDI  technicians.  Other 
bases  had  more  personnel  than  could  be  reasonably  assigned  to  this  program.  For  such 
cases,  prospective  candidates  were  selected  at  random.  This  was  accomplished  by 
assigning  identification  numbers  serially  and  selections  made  from  a table  of  random 
numbers.  For  example,  if  there  was  a need  for  10  eddy  current  NDI  technicians  but 
there  are  30  available,  identification  numbers  were  assigned  in  sequence  from  1 to  30 
and  the  ten  selections  made  from  the  first  ten  numbers  in  o random  sequence  of  numbers 
from  1 to  30.  The  selected  personnel  were  then  scheduled  for  the  oiientation  briefing. 

2.  Orientation 

An  orientation  for  instruction  and  information  purposes  was  prepared  in  a narrative 
which  was  keyed  to  35mm  slides  for  an  audio/visuol  presentation,  providing  consistent 
instruction  throughout  the  dota  acquisition  effort.  Back-projected  imoges  were  pre- 
sented on  a screen  with  flic  device  shown  in  Figure  3-11,  which  contained  a tape 
replay  mechanism  for  the  narration  and  automatic  slide  advance.  The  complete  orien- 
tation is  presented  in  the  Test  Plan  (Reference  10).  Scheduling  and  assignments  were 
performed  at  the  conclusion  of  the  orientation  briefing. 

3.  Scheduling 

A matrix  of  NDI  tasks  and  personnel,  referenced  to  the  structure  sample  types  and 
NDI  method,  is  presented  in  Figure  3-12.  This  matrix  was  designed  to  ensure 


3-14 


compatibility  of  simultaneous  inspections  on  the  structure  samples  and  to  optimize 
scheduling  efficiency.  The  primary  function  of  the  matrix  was  for  coordination  by 
the  Lockheed  engineer  and  local  base  management. 

4.  Inspections 

The  NDI  was  performed  under  the  guidance  and  coordination  of  the  accompanying 
Lockheed  engineer.  A minimum  amount  of  individual  instruction  beyond  the 
orientation  was  occasionally  required  in  special  cases,  but  the  goal  was  to  avoid 
assistance  which  could  bias  results.  The  NDI  procedures  were  supplied  together 
with  general  inspection  information  as  a manual  for  the  inspections  in  this  program . 
Participants  were  given  ample  opportunity  to  read  the  procedures  and  ask  questions 
before  proceeding. 

5.  Sample  Cleaning  and  Recycle 

Marks  on  structure  samples  to  denote  detected  cracks  were  made  with  grease  pencils 
by  the  technician  and  removed  with  solvent  after  transcribing  to  the  data  sheets. 
Penetrant  residing  in  Type  C structure  samples  after  each  inspection  was  removed  by 
ultrasonic  cleaning  in  an  isopropyl  alcohol  bath.  Both  of  these  cleaning  operations 
were  performed  by  the  Lockheed  engineer.  Fifty  cycles  of  penetrant  application  and 
removal  on  a Type  C sample  had  been  previously  conducted  to  ensure  that  no  biasing 
effects  are  introduced  by  repeated  cleaning.  Results  of  this  test  showed  no  significant 
changes  for  penetrant  response,  yet  the  cleaning  is  effective  for  penetrant  removal . 

The  routine  cleaning  required  to  perform  the  penetrant  NDI  was  performed  by  the 
technician.  Penetrant  NDI  was  planned  on  the  Type  C samples  to  follow  ultrasonic 
NDI  which  left  a viscous  coupling  medium  on  the  surfaces.  The  residual  couplant  on 
the  surfaces  inhibited  effective  penetrant  response  to  the  fatigue  cracks  unless  proper 
cleaning  preceded  the  penetrant  application.  This  sequence  of  NDI  methods  was 
intended  for  the  purpose  of  testing  the  NDI  technician's  overall  ability  to  perform 
tasks  according  to  the  procedures. 

6.  Data  T ransmittal 

The  raw  data  was  transmitted  by  mail  or  carrier  from  fhe  field  to  Lockheed.  Upon 
receipt  ot  Lockheed,  the  flow  indications  were  systemized  for  data  processing  in  the 
format  presented  in  F igure  3- 1 3 . Technician  Profiles,  Equipment  Evaluations,  and 
Environment  Reports  were  filed  by  Air  Force  categories  in  their  original  narrative  form. 

All  raw  data,  classified  by  locatiun  at  which  they  vfere  acquired,  were  submitted  to 
the  Air  Force  Logistics  Command  Program  Monitor  both  in  the  reports  of  data  analysis 
and  as  requested  on  occasion  throughout  the  process  of  data  acquisition.  The  purpose 
in  maintaining  the  raw  data  is  for  future  analyses  by  different  methods  or  for  different 
objectives  than  those  set  forth  in  this  program. 
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Figure  3-13.  Basic  Data  Summary  Format 
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7.  Data  Reporting 


Ail  raw  data  were  cataloged  and  available  to  the  Air  Logistics  Command  throughout  the 
period  of  base  visits.  Processed  flaw  detection  data,  incrementally  updated  after  each 
base  visit,  was  reported  to  the  Air  Logistics  Command  at  the  update  times.  The  final 
report  for  the  data  acquisition  arvd  analysis  was  planned  to  contain  the  following: 

a.  Histograms  of  four  flaw  size  ranges  versus  mean  detection  probabilities 
and  probabilities  at  the  50%,  90%,  and  99%  lower  confidence  levels. 

The  histograms  being  classified  by  the  primary  variables  of  depot  or 
field  NDI,  technician  grade  level,  NDI  method,  and  type  of  structure. 

b.  Tests  for  the  significance  of  field  or  depot  site,  NDI  technician,  NDI 
method,  and  flaw  size  influences  on  detection  probabilities  at  a 90% 
confidence  level . 

c.  A compilation  of  non-numerical  data  from  the  forms  on  Technician 
Profiles,  Equipment  Evaluations,  Environment  Reports,  and  Daily  Logs. 

ANALYSIS  OF  RESULTS 


The  data  acquired  in  this  program  were  statistically  evaluated  to  yield  both  graphic  presenta- 
tions of  detection  probabilities  with  regard  to  flow  parameters,  for  given  variables,  and  tests 
for  5'gnificonce  among  variables.  Rather  than  develop  a description  of  the  analysis  here,  the 
reader  is  referred  to  Section  IX,  Analysis  Methodology. 
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SECTION  IV.  DATA  ACQUISITION 


After  preparation  of  all  structure  scmples,  inspection  procedures,  data  sheets  and  support 
fixtures  and  equipment,  a "Dry  Run"  of  progrom  logistics  and  data  acquisition  was  conducted 
at  the  4950th  Air  Base  Wing,  Wright-Pjtteison  Air  Force  Base,  Ohio,  during  16-26  June 
1975.  Everything  necessary  for  the  field  data  collection  phase  of  the  progrom  was  trans- 
ported in  a specially-built  16'  utility  trailer.  Major  items  included  the  structure  samples, 
two  2-drawer  file  cabinets  (with  a specially-constructed  top  so  that  a desk  could  be  assembled), 
three  6'  tables,  6 folding  chairs,  2 bulletin  boards,  1 ultrasonic  cleaner  (for  cleaning  speci- 
mens after  penetrant  inspection),  the  inspection  procedures  and  data  sheets,  and  miscellaneous 
markers,  tablets,  pencils,  and  other  supplies. 

Wright-Patterson  Air  Force  Base 

The  program  "Dry  Run"  was  set  up  at  Wright-Patterson  Air  Force  Base  in  a large  hanger  bay. 
Program  briefings  were  given  tc  management  personnel  and  to  the  NDI  technicians  who  were 
to  participate  in  the  program.  8oth  briefings  were  delivered  by  use  of  the  desk-top  slide 
projector  (back  projector")  thef  contained  a cassette  tope  player  and  its  own  screen  (see  Figure 
3-11).  A cassette  tape  was  used  to  make  the  oral  parr  of  the  presentation.  This  tape  was  keyed 
with  on  inaudible  signal  that  signalled  the  machine  to  change  slides  at  the  proper  time  during 
the  presentation.  This  approach  was  taken  so  that  all  briefings  given  during  the  program  would 
be  identical,  thus  avoiding  a potential  bias  in  attitude  and  understanding. 

The  management  briefing,  approximately  20  minutes  long,  provided  a description  of  the  pro- 
gram and  its  goals  and  a discussion  of  associated  engineering  and  scientific  technologies. 

The  technician  briefing,  also  about  20  minutes  long,  described  the  program  and  informed  the 
technicians  what  they  were  to  do  in  the  program  and  how  to  complete  the  required  data  sheets. 

After  the  equipment  was  set  up  and  suitably  arranged  and  the  briefiiigs  were  completed,  the 
participating  technicians  were  given  their  assignments.  When  an  assigned  inspection  task 
was  completed  and  the  detected  flaws  were  properly  recorded  on  the  data  sheets,  the  techni- 
cian was  given  another  NDI  assignment.  This  procedure  was  continued  as  long  as  the  tech- 
nician was  available  to  the  program  or  until  he  had  completed  all  assignments  in  the  program. 

During  the  stay  at  Wright-Patterson  Air  Force  Base,  many  Air  Force  scientists  and  engineers 
visited  the  area  to  observe  the  program  as  it  was  being  conducted.  Comments  and  suggestions 
for  program  improvement  were  solicited  from  many  of  these  knowledgeable  observers.  The 
program  progressed  well  and  was  completed  on  schedule.  Minor  changes  resulting  from  the 
"Dry  Run"  were  made  in  several  of  the  detailed  NDI  procedures  and  accompanying  data  sheets. 

Having  incorporated  desired  changes  from  the  "Dry  Run"  and  after  finalizing  and  reproducing 
the  procedures  and  all  data  sheets,  final  preparations  were  mode  for  the  progrom  to  depart 
for  an  approximate  two-year  tour  of  selected  Air  Force  bases.  The  four  bases  visited  within 
each  major  command  were  selected  by  the  Air  Force  Command  NDI  Monitor  representing  that 
command  (see  Figure  4-1). 
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TOTAL  NDI  ACTIVITY* 
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% 
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% 
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% 
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% 
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AFLC  Hill 

16 

24 

16 

17 

27 

Kelly 

9 

6 

10 

4 

71 

McClellan 

18 
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10 
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20 

Tinker 

2 

7 

2 

61 

28 

Warner  Robins 

5 

6 

5 

12 

72 

ATC  Randolph 

2 

1 

1 

49 

47 

Reese 

3 

5 

2 

57 

33 

Webb 

4 

10 

7 

50 

29 

Will  iarr.s 

1 

1 

2 

22 

74 

MAC  Charleston 

16 

26 

5 

52 

1 

Dover 

9 

21 

3 

48 

19 

McC  hord 

26 

17 

13 

25 

19 

Travis  * 

16 

27 

6 

45 

6 

SAC  Carswell 

1 

15 

0 

82 

2 

Ellsworth 
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^Excluding  Magnetic  Particle 

Data  derived  from  information  submitted  by  NDI  technicians  - Probably  questionable 
for  the  Logistic  Commands  because  not  all  technicians  could  participate,  as  was 
generally  the  cose  at  the  bases. 


Figure  4-1  . 


Percent  of  Regularly  Assigned  Aircraft  Inspections  for  each  NDI  Technique 
at  Bases  Visited 
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Randolph  Air  force  Bate 


The  fir' I bote  to  c>e  visited  wot  an  Air  Trainin')  Command  (ATC)  bate,  Randolph  Air  Force  ftme, 
in  San  Antonio,  Texas.  T>«  program,  now  known  by  its  nickname,  "Hove  Crecfcs-Will  Travel,  “ 
wat  initiated  there  on  14  October  1975.  The  ATC  utilize!  one  standard  building  design  lor 
tire ir  NOI  shops.  One  section  of  the  building  contains  the  inspection  shops  mod  offices  ond 
fire  other  section  is  an  X-ray  bay  which  is  lorge  enough  to  contain  an  entire  fighter  aircraft. 
Tire  facility  of  Randolph  was  reasonably  new  and  in  excellent  condition. 

The  program  uti!  *y  frailer  was  unloaded  and  positioned  in  one  corner  of  the  X-ray  bay, 
i!  .v.;.  ■-  X-ray  part  of  Site  program  to  simulate  on  aircraft  fuseloge.  The  struc- 

ture samples  and  all  auxiliary  equipment  were  set  up  in  the  inspection  shop  oreas  which  were 
temperature  conholled  ond  well  lighted. 

The  NDI  Shop  Chief  at  Randolph  was  a civilian  with  a M/Sgt  second  in  command.  A total 
of  nine  technicians  participated  in  the  program  at  this  facility.  Four  of  these  were  Level  7 
ond  five  were  Level  5.  All  were  military  except  one  civilian  who  was  retired  from  the  Air 

Force . 

Excluding  magnetic  particle,  inspection  methods  predominantly  used  at  this  facility  were 
penetrant  and  x-ray.  Approximately  49%  of  the  normal  inspections  conducted  were  penetrant 
ond  about  47%  were  x-ray.  The  other  4%  was  about  equally  divided  between  ultrasonic  and 
eddy  current  (see  Figure  4-1).  During  the  four-week  period,  the  nine  participants  carried 
out  48-1/2  inspection  projects.  The  program  was  concluded  ot  Randolph  on  19  November 
1975. 

The  weather  in  Sac  Antonio  during  the  Randolph  AFB  visit  ranged  from  hot  during  the  first 
part  of  the  period  'o  mild  ond  cool  during  the  latter  port  of  the  period.  Although  there  were 
great  extremes  in  weather  from  one  bose  to  another  during  the  2-yeor  period,  almost  oil 
inspection  fosks  were  conducted  inside  temperature-controlled  buildings,  os  ore  most  routine 
Air  Force  inspections.  Therefore,  weather  should  not  be  considered  o variable  with  relotion 
to  tie  ND!  reliability  results. 

Kelly  Air  Force  Bose  (Depot) 

The  second  Air  Force  facility  to  be  visited  was  olso  in  San  Antonio,  Texas,  'the  Son  Antonio 
Air  Logistics  Center  at  Kelly  Air  Force  Bose . The  move  wos  accomplished  on  20  November 
1975,  and  program  operations  were  sto'ted  on  21  November.  Since  the  depot  ot  Kelly  AFB 
was  the  monitoring  facility  for  the  entire  progrom,  manogement  there  hod  been  previously 
briefed  and  were  entirely  familiar  with  the  program. 

The  program  structural  samples  ond  all  auxiliary  equipment,  including  the  utility  trailer,  were 
initially  set  up  in  a lorge  unheated  hanger.  All  samples  and  equipment,  except  the  trailer, 
were  subsequently  moved  into  on  unused  office  area  in  the  hanger  building  ond  o portable 
heater  wos  set  up  for  use  when  required.  The  outside  temperature  ranged  from  the  low  30's 
to  low  50’s  during  the  five  weeks  ot  Kelly  Air  Force  Base. 
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Participating  personnel  at  Kelly  AF6  were  all  civilians.  All  technicians  that  participated 
in  the  eddy  current  inspection  tasks  were  classified  as  Aircraft  Sheet  Metal  Mechanics. 

They  were  certified  to  do  eddy  current  and  penetrant  inspections.  The  technicians  that  did 
ultrasonic  inspection  tasks  were  classified  as  Ultrasonic  Equipment  Operators,  and  although 
they  may  be  certified  in  other  NDI  techniques,  they  primarily  do  ultrasonic  inspections. 

The  technicians  that  did  .he  penetrant  tasks  were  classified  as  Aircraft  Sheet  Metal  Inspectors 
and  some  of  these  were  also  certified  in  eddy  current.  All  the  technicians  above,  except 
ultrasonic,  do  NDI  on  a part-time  basis  as  required,  as  part  of  their  regular  sheet-metal  jobs. 
The  x-ray  projects  were  done  by  Industrial  Radiographers,  some  of  whom  were  certified  in 
ultrasonics,  but  they  all  predominantly  do  only  radiography. 

Although  airframe  NDI  functions  are  normally  done  in  several  organizations,  radiography 
accounts  for  approximately  70%  of  all  the  nondestructive  inspections  done  at  Kelly  (not 
considering  magnetic  particle  NDI).  The  other  techniques  employed  range  from  3 to  10% 
each  (see  Figure  4-1). 

Because  of  the  large  number  of  inspectors  at  Kelly  Air  Force  Base,  ? moximum  size  groups 
useable  on  the  program  were  scheduled  to  participate  for  given  periods  of  time.  At  the 
beginning  of  each  scheduled  period,  the  technician  briefing  was  presented  and  then  assign- 
ments were  made.  A total  of  47  people  participated  to  carry  out  128  inspection  tasks. 

Inspectors  doing  the  eddy  current  and  penetrant  tasks  Indicated  wide  variations  in  their 
normal  frequency  of  conducting  these  type  inspections.  Some  do  these  type  inspections 
frequently  and  some  may  have  a gap  of  several  months  between  successive  eddy  current  or 
penetrant  inspections.  The  radiographers  do  only  radiographic  NDI.  Some  radiographers 
appear  to  be  used  only  as  helpers  and  have  received  a minimum  of  on-the-job  training  in 
the  radiography  process.  The  ultrasonic  technicians  apparently  do  a considerable  amount  of 
ultrasonic  inspector,  for  the  number  of  technicians  available,  and  were  very  busy  during  the 
time  the  program  was  at  Kelly  AFB, 

Bergstrom  Air  Force  Base 


Operations  at  Kelly  AFB  were  completed  just  before  the  Christmas  holidays,  and  all  equip- 
ment remained  there  until  after  the  holiday  period.  All  samples  and  equipment  were  then 
packed  in  the  trailer  and  moved  to  Bergstrom  Air  Force  Base,  Austin,  Texas,  in  early 
January  1976.  Bergstrom  AFB  is  a Tactical  Air  Command  (TAC)  base,  and  like  ATC,  TAC 
uses  a standard  building  design  for  all  NDI  shops.  The  shop  and  office  areas  of  these  build- 
ings are  similar  to  the  ATC  design,  but  the  adjoining  x-ray  bay  is  much  smaller.  The  program 
trailer  was  a Few  inches  too  wide  to  fit  into  the  x-ray  bay.  The  building  was  relatively  new 
and  in  excellent  condition. 

After  setup  and  briefings  at  Bergstrom  Air  Force  Base,  operations  were  started  on  12  January 
1976.  All  inspectors  were  military  personnel  beie  with  a M/Sgt  acting  as  Non  Commissioned 
Officer  In  Charge  (NCOIC).  A total  of  seven  technicians  participated  in  the  program.  Four 
were  Level  7 and  three  were  Level  5 technicians.  During  the  four-week  period,  a total  of 
31  inspection  tasks  were  completed.  The  x-ray  projects  were  performed  at  o remote  location 
with  auxiliary  power  since  this  was  typical  for  their  facility. 
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The  type  of  NDI  work  normally  done  at  Bergstrom  Af  B included  significant  efforts  in  eddy 
current,  penetrant,  and  x-ray.  Considering  only  the  techniques  being  evaluated,  approxi- 
mately 25%  of  the  routine  inspections  were  eddy  current  surface  probe,  16%  were  bolt-hole 
probe,  4%  were  penetrant  and  14%  were  x-ray.  No  normal  NDI  work  was  done  using  ultra- 
sonics. Inspection  personnel  therefore  experienced  some  difficulty  with  setting  up  the  ultra- 
sonic instrumentation  for  use  cn  the  program  samples,  but  several  ultrasonic  inspections  were 
accompl  ished . 


The  weather  at  Bergstrom  AFB  ranged  from  the  low  30‘s  in  the  mornings  into  the  70's  in  the 
afternoon  and  was  generally  sunny  and  mild. 

The  program  was  completed  at  Bergstrom  on  6 February  1976.  Program  equipment  was  then 
transported  to  Big  Spring,  Texas  for  use  at  the  next  installation,  Webb  Air  Force  Base. 

Webb  Air  Force  Base 

Webb  Air  Force  Base  is  an  Air  Training  Command  Base  and  the  NDI  shop  has  the  same  design 
as  the  one  at  Randolph  AFB.  Again,  the  trailer  was  located  inside  the  large  x-ray  bay. 

The  program  at  Webb  AFB  was  started  on  17  February  1976,  after  having  set  up  the  equip- 
ment and  performed  the  management  and  technician  briefings  the  prior  week.  All  personnel 
were  military,  with  a M/Sgt  assigned  as  NCOIC  . Ten  technicians  participated  in  the 
program.  There  were  three  Level  3,  four  Level  5,  and  three  Level  7 technicians. 

With  relation  to  the  NDI  techniques  of  interest  to  the  program,  about  50%  of  the  normal  in- 
spections that  Webb  AFB  conducted  were  penetrant  and  29%  were  x-ray  inspections.  Eddy 
current  NDI  ranked  third  at  about  17%  for  surface  probe  and  bolt  hole  probe  combined. 

Only  about  4%  of  the  inspections  at  Webb  were  ultrasonic.  No  problems  were  encountered 
with  the  use  of  ultrasonics,  however,  as  was  the  case  at  some  other  locations. 

The  program  was  completed  at  Webb  AFB  on  12  March  1976,  with  36  inspection  tasks  com- 
pleted. The  weather  during  the  month  was  cool  to  warm  with  high  wind  most  of  the  time. 
Dust  storms  were  frequent, 

Reese  Air  Force  Bose 

The  program  was  transported  next  to  Reese  Air  Force  Base  in  Lubbock,  Texas.  Reese  AFB  is 
also  an  ATC  installation.  Equipment  was  set  up  and  briefings  were  conducted  during  the 
week  of  15  March  1976,  and  the  program  was  started  there  on  22  Morch  1976.  Since  Reese 
AFB  is  an  ATC  base,  the  hardware  was  set  up  in  the  some  configuration  as  at  Randolph  AFB 
and  Webb  AFB.  All  personnel  were  military  and  the  NCOIC  was  a M/Sgt.  Five  technicians 
participated  in  the  program.  One  was  Level  3,  three  were  Level  5,  and  one  was  Level  7. 

Routine  nondestructive  inspection  techniques  normally  utilized  at  Reese  included  significant 
efforts  in  penetrant  and  x-ray,  with  considerably  smaller  efforts  in  eddy  current  and  ultra- 


4-5 


sonics.  Excluding  magnetic  particle,  about  57%  of  the  Reese  inspections  were  penetrant, 
33%  were  x-ray,  7%  were  eddy  current  and  about  3%  were  ultrasonic  at  the  time  of  tire  pro- 
gram visit.  Although  instrument  setup  probably  took  a little  longer  than  normal,  several 
ultrasonic  inspection  tasks  were  completed  on  the  program  samples.  No  problems  were  en- 
countered with  eddy  current  inspections.  A total  of  14-1/2  inspection  tasks  were  completed 
during  the  period  that  the  program  was  at  Reese  AFB. 

The  program  was  completed  at  Reese  AFB  on  16  April  1976.  During  the  four  weeks  the 
weather  there  was  generally  mild  and  windy. 

Offutt  Air  Force  Base 

The  program  was  next  moved  to  Offutt  Air  Force  Base,  Omaha,  Nebraska,  which  is  the 
Headquarters  for  the  Strategic  Air  Command  (SAC).  Briefings  and  equipment  setup  were 
completed  on  20-21  April  1976  and  program  operations  begun  on  22  April . 

The  NDI  shop  at  Offutt  AFB  is  set  up  in  a portion  of  a large  building.  There  was  adequate 
room  in  this  area  for  oil  NDI  equipment,  including  the  x-ray  facilities,  magnetic  particle, 
penetrant  and  SOAP  (Spoctrographic  Oil  Analysis  Program),  as  well  as  the  ultrosonic  and 
eddy  current  activities.  There  was  enough  room  in  the  area  to  conveniently  set  up  the 
reliability  program  equ  pment  and  the  structure  samples. 

All  personnel  were  military  and  consisted  of  the  NCOIC  and  4 technicians.  Four  personnel 
were  on  the  standard  day  shift  and  one  worked  a 9 pm  to  5 am  shift.  Two  of  the  five  were 
Level  5 ond  three  were  Level  7.  During  the  month  they  completed  20  inspection  tasks, 

Inspection  techniques  of  concern  to  the  reliability  program  that  were  routinely  conducted  at 
Offutt,  include  penetrant,  which  was  used  for  about  90%  of  Offutt  's  inspections,  eddy 
current  and  ultrasonics  which  togetlier  accounted  for  about  9%  of  the  inspections,  and  x-ray 
accounted  for  less  than  1%. 

The  scheduled  visit  at  Offutt  was  completed  on  17  May  1976.  During  the  four  weeks  in 
Omaha,  the  weather  was  cooi  to  mild  with  some  rain. 

Wiiliams  Air  Force  Base 


The  next  move  was  to  the  fourth  and  iast  ATC  base,  Williams  AFB  in  Chandler,  Arizona.  As 
at  previous  ATC  bases,  the  trailer  was  unloaded  and  then  positioned  inside  the  x-my  boy. 

All  other  equipment  was  set  up  in  the  NDI  shop  area. 

The  management  brief'tig  was  given  on  27  May  1976  and  the  trailer  was  unlooded  and  thie 
equipment  set  up  the  following  day.  Technician  biiefings  were  carried  out  and  program 
operations  were  started  on  1 June  1976. 

All  personnel  at  Williams  Air  Force  Base  were  military  and  consisted  of  tfse  NCOlC  and  six 
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technicians  on  day  shift  and  two  technicians  on  tlte  evening  shift.  Six  technicians  partici- 
pated in  the  program  and  completed  19  inspection  tasks  during  the  month.  Alt  six  of  the 
participating  technicians  were  Level  5. 

With  respect  to  the  inspection  techniques  being  evaluated,  on  a routine  basis  Williams  AFB 
used  x-ray  for  about  74%  of  the  inspections  normally  accomplished  and  penetrant  for  about 
22%  of  the  inspections.  Eddy  current,  both  surface  scan  and  bolt  hole  scan  were  utilized 
for  only  about  3%  of  the  inspections,  but  there  was  little  or  no  requirement  for  ultrasonic 
inspection  (less  than  1%). 


The  scheduled  visit  at  Williams  AFB  was  completed  on  25  June  1976.  The  weather  during 
the  4 weeks  was  consistently  clear  and  hot,  usually  over  100  F during  the  day. 

George  Air  Force  Base 

The  next  move  was  to  the  second  TAC  base  visited  on  the  tour,  George  Air  Force  Base  in 
Victorville,  Californio.  The  trailer  was  moved  into  the  area  and  unloaded  on  1 July  1976, 
and  the  management  briefing  was  also  given  on  that  day.  Setup  of  equipment  was  completed 
the  following  day  and  technician  briefings  and  program  inspections  began  on  6 July  1976. 
Fourteen  technicians  participated  in  the  program  and  completed  39  inspection  tasks  during 
the  visit.  Four  of  the  technicians  were  level  3,  eight  were  Level  5,  and  two  were  Level  7. 

NDI  routinely  utilized  at  George  AFB  included  all  of  the  four  methods  evaluated  in  this 
program.  The  penetrant  technique  was  utilized  for  about  58%  of  the  inspections  normally 
conducted,  with  x-ray  and  eddy  current  next  at  21%  and  17%,  respectively.  Ultrasonics 
is  the  least  used  of  the  techniques  and  accounted  for  about  only  4%  of  the  total  inspections 
routinely  accomplished  at  George  AFB. 

The  program  was  completed  at  George  AFB  on  30  July  1976.  The  weather  during  the  month 
was  clear  and  hot . 

Travis  Air  Force  Base 

The  program  was  then  moved  to  Travis  Air  Force  Base,  which  is  located  in  Fairfield, 
California.  This  was  the  first  Military  Airlift  Command  (MAC)  base  to  be  visited.  The  NDI 
facility  was  in  a portion  of  a larger  building.  There  was  adequate  room  for  the  work  to  be 
done,  and  lighting  and  temperature  control  were  standard. 

The  trailer  was  moved  onto  the  base  on  5 August  1976  and  it  was  unloaded  and  the  equipment 
set  up  during  5-6  August.  The  management  briefing  was  conducted  on  6 August,  and  program 
operations  were  started  on  9 August  1976.  After  being  unloaded,  the  trailer  was  located  in 
a nose  hanger  at  a location  suitably  remote  for  operating  x-ray  equipment. 

The  NDI  shop  personnel  wore  a mixture  of  military  and  civilian.  The  shop  supervisor  was  a 
civilian  with  a M/Sgt  second  in  command.  Thirty-one  technicians  participated  in  the  pro- 
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gram  and  completed  34  inspection  tasks.  Five  of  the  technicians  were  Level  7 , 18  were 
Le  vel  5,  and  eight  wero  Love!  3. 

At  Travis,  all  NDI  techniques  of  interest  to  the  program  were  utilized.  Penetrant  was  nor- 
mally used  for  about  45%  of  the  inspections,  while  eddy  current  accounted  for  33%,  ultra- 
sonic for  16%,  and  x-ray  for  6%. 

Tire  program  was  completed  at  Travis  on  3 September  1976.  The  weather  during  the  month 
was  generally  mild  to  cool . 

McClellan  Air  Force  Base  (Depot) 


The  program  equipment  was  next  transported  to  the  second  Air  Force  Logistics  Center, 
McClellan  Air  Force  Base  in  Sacramento,  California.  The  NDI  shop  is  located  in  a large 
hanger  type  building  partitioned  to  make  several  x-ray  cells,  work  areas,  and  offices.  The 
x-ray  cells  are  lead-lined  and,  via  a large  sliding  door,  open  directly  onto  the  concrete 
apron.  The  building  is  located  right  on  the  flight  line. 

On  9 September,  the  management  briefing  was  given,  and  on  10  Septembei  the  trailer  was 
unloaded  on  the  apron  in  front  of  the  x-ray  cells.  All  structure  samples  and  equipment 
were  moved  into  one  of  these  cells  and  the  trailer  was  then  moved  into  an  adjacent  cell. 

On  13  September  1976,  the  orientation  briefing  was  given  to  the  participating  technicians 
and  program  operations  wore  started.  All  personnel  were  civilian.  Twenty-five  technicians 
participated  in  the  program  and  completed  55-1/2  inspection  tasks.  Technicians  were 
classified  as  Nondestructive  Inspection  Specialist,  Ultrasonic  Equipment  Operator,  Industrial 
Radiographer,  and  Liquid  Penetrant  and  Magnetic  Particle  Inspectors.  However,  within  these 
job  classifications,  technicians  were  certified  as  Level  1 or  Level  2 in  inspection  techniques 
other  than  those  indicated  by  the  job  title. 

All  NDI  techniques  were  extensively  utilized  at  McClellan  AFB.  Considering  the  techniques 
being  evaluated,  penetrant  accounted  for  about  half  of  the  inspections  normally  conducted 
at  McClellan  AFB,  x-ray  accounted  for  approximately  20%,  ultrasonics  for  about  18%,  and 
eddy  current  for  about  12%. 

The  program  was  completed  at  McClellan  AFB  on  15  October  1976,  The  weather  during  the 
month  was  mild  and  sunny. 

McCItord  Air  Force  Base 


The  program  was  moved  next  to  McCliord  Air  Force  Base  in  Tacoma,  Washington.  This  was  the 
second  MAC  base  visited. 

The  trailer  was  moved  on  base  on  21  October  1976  and  unloaded  at  the  NDI  shop.  The  NDI 
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shop  is  on  the  front  portion  of  a honger  and  consists  of  on  office  area,  a large  work  area  in 
the  mid  section  and  smaller  work  a.eas  in  the  rear.  The  shielded  x-ray  room  is  located  just 
outside  of  the  NDI  shop  in  the  open  hanger.  The  trailer  was  moved  into  the  x-ray  room  for 
the  radiography  portion  of  the  program. 

The  management  briefing  was  given  for  the  Chief  of  Maintenance  and  his  staff  on  22  October 
1976.  The  technician  briefing  was  presented  to  the  participating  technicians  on  26  October 
and  program  operations  were  started  the  same  day.  Technicians  were  both  military  and  civi- 
lian at  McChord  AFB.  The  shop  supervisor  was  art  Air  Force  Sergeant. 

Six  technicians  participated  in  the  program  and  completed  13  inspection  tasks.  One  techni- 
cian was  Level  3 and  the  other  five  were  Level  5.  All  NDI  techniques  of  interest  to  the 
program  were  about  equally  utilized  at  McChord  AFB.  Ultrasonic  normally  accounted  for 
approx i lately  26%  of  the  inspections  conducted  there,  penetrant  for  about  25%,  eddy  current 
for  about  30%,  and  x-ray  for  about  19%. 

The  program  was  completed  at  McChord  AFB  on  19  November  1976.  During  the  month  the 
weather  was  mild  to  cool. 

Dover  Air  Force  Base 


At  this  point  in  lime,  there  was  an  Air  Force  requirement  to  determine  the  inspection  reli- 
c ility  at  Dover  Air  Force  Base,  Dover,  Delaware.  Dover  Air  Force  Base  is  a MAC  base. 
Certain  " Hot  Spot"  inspections  were  scheduled  on  C-5  aircraft  at  Dover  Air  Force  Base 
after  the  first  of  the  year.  It  was  desired  to  evaluate  Dover  inspection  reliability  prior  to 
performing  these  "Hot  Spot"  inspections.  Therefore,  the  program  traveled  cross-country 
from  Tacoma,  Washington,  to  Dover,  Delaware,  during  the  latter  part  of  November,  1976. 

The  frailer  was  moved  on  base  and  unloaded  on  2 December  1976.  The  management  briefing 
was  given  to  the  Chief  of  Maintenance  and  his  staff,  and  the  technician  briefing  was  given 
to  the  day  shift  and  to  the  swing  shift.  On  3 December,  the  graveyard  shift  was  briefed  and 
assignments  were  made  for  all  shifts. 

Personnel  at  Dover  AFB  were  both  military  and  civilian,  and  the  shop  supervisor  was  an 
Air  Force  M/5gt.  Thirty-two  technicians  participated  at  Dover  AFB  and  completed  87 
inspection  tasks.  Three  technicians  were  Level  3,  seventeen  were  Level  5,  seven  were 
Level  7,  and  the  NCOIC  was  Level  9 (four  technicians  did  not  specify  their  AFSC). 

The  NDI  shop  at  Dover  AFB  consists  of  one  large  work  area  with  a partitioned  office  off  to 
one  side.  There  is  one  other  smaller  partitioned  work  area  at  the  back  of  the  shop.  The 
area  is  well  lighted  and  temperature  controlled.  There  was  no  x-ray  facility  large  enough 
to  house  the  trailer;  fience,  it  was  set  up  in  the  bay  of  o hanger  and  roped  off  during  x-ray 
operations. 

Two  additional  NDI  techniques  were  added  to  the  program  at  Dover,  One  was  a semi- 
automatic ultrasonic  device  that  was  designed  to  rotate  around  the  fastener  site  (see  Section 
VI  for  complete  desorption)  and  the  other  was  the  addition  of  a procedure  for  use  of  the 
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Gulfon  automatic  eddy  current  bolt  hole  instrument  (see  Section  VI).  Written  instructions 
for  the  application  of  both  techniques  were  provided,  along  with  the  necessory  instruments 
and  practice  samples.  The  ultrasonic  device  was  utilized  to  inspect  sample  A ond  the  Gulton 
instruments  were  used  to  inspect  samples  D,  E and  F . 

All  standard  NDI  techniques  are  routinely  used  at  Dover  AFB;  however,  the  penetrant  tech- 
nique  is  utilized  for  almost  half  of  all  inspections.  Eddy  cunent  is  used  for  approximately 
24%  of  the  inspections,  x-ray  for  19%,  and  ultrasonic  for  about  9%. 

The  program  was  completed  at  Dover  aFB  on  2!  January  1977.  During  the  month  at  Dover, 
the  weather  varied  from  fairly  warm  (40°F)  to  extremely  cold  (-4°F)  with  both  rain  and  snow 
occurring. 

Pease  Air  Force  Base 


Since  the  program  was  moved  to  the  east  coast,  the  original  schedule  was  modified  so  that 
Pease  AFB  in  Portsmouth,  New  Hampshire  would  be  the  next  base  to  be  visited.  Pease  AFB 
became  the  second  SAC  base  to  participate  in  the  program. 

The  Chief  of  Maintenance  was  briefed  in  the  morning  on  28  January  1977  and  the  partici- 
pating technicians  were  briefed  in  the  afternoon.  The  trailer  was  brought  on  base  on  the 
same  day  and  all  equipment  was  unloaded  and  the  trailer  was  parked  outside  the  NDI  shop. 
On  the  following  Monday,  31  January,  assignments  were  made  and  program  operations  were 
started . 


The  NDI  shop  at  Pease  AFB  was  a part  of  a larger  building  and  consisted  of  a large  work  area 
with  overhead  sliding  doors  at  one  end.  The  x-ray  room  was  adjacent  in  the  same  end  of  the 
building,  but  was  too  small  to  house  the  trailer.  The  trailer  was  parked  outside  the  overhead 
doors,  but  was  brought  inside  the  NDI  shop  when  the  radiography  part  of  the  program  was 
initiated.  The  area  was  well  lighted  and  temperature  controlled. 

All  NDI  personnel  at  Pease  AFB  were  military.  Three  technicians  participated  in  the  pro- 
gram and  completed  12  inspection  tasks.  All  three  technicians  were  Level  5. 

Each  of  the  four  standard  NDI  techniques  being  evaluated  are  used  at  Pease  AFB,  but 
penetrant  inspections  constituted  about  61%  of  these  normal  inspection  requirements.  Eddy 
current  accounted  for  about  19%,  ultrasonic  for  about  16%,  and  x-ray  for  about  4%. 


The  program  was  completed  at  Pease  AFB  on  25  February  1977.  During  tlie  month  the 
weather  was  relatively  mild  for  Portsmouth  in  February,  but  the  ground  and  parking  lots 
were  covered  with  ice  and  snow  the  entire  time, 

Ellsworth  Air  Force  Base 

The  program  was  next  moved  to  Ellsworth  AFB  which  is  located  in  Rapid  City,  South  Dakota, 
Ellsworth  AFB  was  the  third  SAC  base  to  participate  in  the  program. 
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Tha  management  briefing  was  held  in  the  morning  on  10  March  1977.  The  trailer  was 
brought  on  base  and  unloaded  in  the  afternoon.  The  equipment  was  set  up  and  the  staff 
of  three  were  given  the  technician  briefing  on  the  following  day.  The  program  was  started 
there  on  Monday,  14  March  1977. 

The  NDI  shop  at  Ellsworth  AFB,  which  is  located  near  the  flight  line,  is  like  those  at  the 
TAC  bases.  The  x-ray  facility  was  too  small  to  house  the  trailer  so  it  was  parked  outside 
the  building . 

All  personnel  at  Ellsworth  AFB  were  military.  The  three  technicians  participated  in  the  pro- 
gram and  completed  8 inspection  tasks.  (One  week  at  Ellsworth  AFB  was  nonproductive 
because  the  base  was  closed  due  to  a blizzard.)  Two  of  the  technicians  were  Level  7 and 
one  was  Level  5 . 

Although  all  of  the  NDI  techniques  being  evaluated  by  the  program  were  used  at  Ellsworth 
AFB,  penetrant  was  the  predominant  technique  normally  employed.  Penetrant  was  utilized 
for  87%  of  the  inspections  carried  out  at  Ellsworth  AFB.  Eddy  current  was  utilized  for  about 
8%  of  their  inspections  and  ultrasonic  and  x-ray  accounted  for  3 and  2%,  respectively. 

The  program  was  completed  at  Ellsworth  AFB  as  scheduled  or.  8 April  1977.  During  tire 
month  the  weather  was  initially  cold  with  high  winds.  For  the  first  two  weeks  tlx;  weather 
improved  until  it  was  mild  and  into  the  low  70's,  however,  the  winds  were  high  the  entire 
time  . On  Monday  of  the  third  week  ut  Ellsworth  AFB,  it  began  to  snow  in  the  morning  and 
by  Tuesday  morning,  10"  had  fallen  and  the  base  was  closed.  By  Wednesday  morning  25" 
had  accumulated  and  the  base  and  town  were  closed  for  tlie  remainder  of  the  week.  By  the 
middle  of  the  following  week  temperatures  were  back  up  to  60  F . 

Hill  Air  Force  Base  (Depot) 

The  next  move  was  to  the  third  AFLC  base,  Hill  Air  Force  Base  in  Ogden,  Utah.  Operations 
were  started  there  on  20  April  1977.  Small  equipment  and  samples  were  set  up  in  a second 
story  room  that  was  not  being  used  at  the  time.  Entry  was  from  the  outside  via  an  outside 
stairway.  The  large  structure  samples  were  set  up  in  an  engine  test  facility  on  the  ground 
floor.  The  x-ray  work  was  done  in  a separate  hanger  that  was  large  enough  to  Isold  an  entire 
aircraft,  so  the  trailer  was  moved  to  that  location  and  used  for  the  program  x-ray  projects. 

All  inspection  personnel  at  Hill  AFB  were  civilian  with  a variety  of  job  titles.  Participants 
were  classified  as  A/C  Street  Metal  Mechanics,  Machinsts,  Weapons  Repairman,  Ultrasonic 
Test  Equipment  Operators,  A/C  Inspectors,  QA  Specialists,  QA  Technicians,  and  Industrial 
Radiograpliers.  The  A/C  Sheet  Metal  Mechanics  were  certified  for  penetrant,  or  for  both 
eddy  current  and  penetrant.  A few  were  also  schooled  in  ultrasonics  but  did  no  ultrasonic 
work.  The  Machinsts  were  generally  certified  for  ultrasonic,  eddy  current,  penetrant,  and 
mognetic  particle  inspection.  The  Weapons  Repairmen  were  certified  for  eddy  current  only 
and  said  that  they  had  conducted  no  inspections  in  the  lost  2 years.  The  Ultrasonic  Test 
Equipment  Operators  were  certified  for  ultrasonic  and  some  combination  of  eddy  current, 
penetrant,  and  magnetic  particle  inspections.  The  one  A/C  Inspector  was  certified  for 
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ultrasonic,  eddy  current,  penetrant  and  mognetic  particle  inspections.  The  QA  Specialists 
and  Technicians  were  certified  in  one  or  more  of  the  four  methods  plus  radiography.  The 
Industrial  Radiographers  were  certified  in  radiography  only. 

Thirty-one  technicians  participated  in  the  program  at  Hill  AFB  and  completed  65-1/2  in- 
spection tasks.  All  standard  inspection  techniques  are  utilized  at  Hill  AFB;  however,  about 
half  of  the  participating  technicians  indicated  that  they  do  little  or  no  NDI  work  on  a rou- 
tine basis . 

Each  of  the  four  methods  evaluated  were  utilized  at  Hill  AFB.  Eddy  current  was  normally 
used  for  approximately  40%  of  the  inspections  carried  out.  X-ray  accounted  for  about  27% 
of  the  inspections,  penetrant  accounted  for  17%,  and  ultrasonic  for  1 6%. 

The  program  was  completed  there  on  20  May  1977.  The  weather  in  Ogden  during  the  month 
was  generally  good  with  o few  days  of  rain  and  light  snow. 

Carswell  Air  Force  Base 

The  program  was  next  moved  to  Carswell  Air  Force  Base  in  Ft.  Worth,  Texas.  Carswell  was 
the  fourth  and  last  SAC  base  scheduled  for  participation . 

All  equipment  and  structure  samples  were  set  up  inside  the  NDI  shop  and  operations  were 
started  there  on  30  May  1977.  All  the  inspection  personnel  were  military.  Four  technicians 
participated  in  the  program  and  completed  8 inspection  tasks.  Two  were  Level  5 and  two 
were  Level  7.  Carswell  AFB  employs  each  of  the  four  methods  evaluated,  however,  pene- 
trant was  utilized  for  about  82%  of  the  inspecfions  normally  conducted.  Eddy  current  was 
utilized  in  about  15%  of  the  inspections  and  x-ray  and  ultrasonic  were  used  about  2%  and 
1%,  respectively. 

The  program  was  completed  there  on  24  June  1977.  The  weather  during  the  month  was  sunny 
and  warm . 

Tinker  Air  Force  Base  (Depot) 


The  next  move  was  to  the  fourth  AFLC,  Tinker  Air  Force  Base  in  Oklahoma  City,  Oklahoma. 
The  program  was  set  up  and  orientations  were  given  on  30  June  and  1 July  and  program 
operations  were  startea  on  5 July. 

The  program  was  conducted  in  the  rear  section  of  a building  that  l>ouses  several  labs,  shops, 
and  offices.  These  were  normally  used  for  combinations  of  storage  and  loading  and  unloading 
equipment.  It  was  well  lighted  and  temperature  controlled.  X-ray  work  was  done  on  the 
graveyard  shift . The  trailer  was  moved  into  an  open  bay  in  the  main  aircraft  assembly 
building  for  the  x-ray  tasks. 

A set  of  76  technician  proficiency  screening  samples  were  added  to  the  program  at  Tinker. 
These  samples  were  16"  x 2"  x 1/4"  with  10  holes  each.  Inspection  techniques  to  be 
applied  to  these  specimens  were  ultrasonic  arid  eddy  current  bolt  hole.  These  specimens  were 
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to  be  inspected  to  investigate  the  possibility  of  using  a simple  structural  sample  for  the 
screening  of  inspection  personnel. 

All  inspection  personnel  ot  Tinker  were  civilians  with  various  job  titles.  Participants  were 
classified  as  A/C  Mechanics,  Sheet  Metal  Workers,  A/C  Engine  Repair  Inspectors,  A/C  Jet 
Engine  Parts  Inspectors,  Blade  Reworkers,  and  Industrial  Radiographers.  The  A/C  Mechanics 
ond  Sheet  Metal  Workers  perform  ultrasonic,  penetrant,  or  eddy  current  inspections  on  a 
part-time  basis  and  may  conduct  up  to  10  inspections  per  month.  The  A/C  Engine  Repair 
Inspectors  and  the  A/C  Jet  Engine  Parts  Inspeclors  perform  penetrant,  eddy  current,  and 
ultrasonic  inspections  on  a full-time  basis.  One  inspector  may  conduct  several  hundred  of 
these  inspections  during  a typical  month  but,  on  the  overage,  over  50%  of  the  inspections 
are  penetrant.  The  Blade  Reworkers  conduct  penetrant  and  eddy  current  inspections  on  several 
thousand  blades  during  a typical  month.  The  Industrial  Radiographers  primarily  do  radio- 
graphy, however,  they  are  certified  for  and  do  some  small  amounts  of  ultrasonic,  eddy  current 
ond  penetrant. 

Twenty-six  technicians  participated  in  the  program  and  completed  75  inspection  projects. 
Although  ail  standard  NDI  techniques  are  utilized  at  Tinker  AFB,  penetrant  is  employed 
for  the  largest  number  of  inspections.  Excluding  the  turbine  blade  inspections  fplus  magnetic 
particle),  penetranl  is  utilized  for  61%  of  the  inspections,  ultrasonic  for  2%,  eddy  current 
for  9%,  and  radiographic  for  28%.  For  the  turbine  blade  inspections,  penetrant  is  utilized 
for  about  75%  of  the  inspections  ond  eddy  current  for  about  25%. 

The  program  was  completed  at  Tinker  AFB  on  12  August  1977.  The  weather  in  Oklahoma  City 
during  the  month  was  generally  sunny  and  hot. 

MacDill  Air  Force  Base 


The  program  was  next  moved  to  MacDill  AFB  in  Tompo,  Florida.  MacDill  was  the  third  TAC 
base  visited  and  the  NDI  shop  is  the  same  as  those  at  the  other  TAC  bases. 

The  trailer  was  brought  on  base  on  22  August,  It  was  unloaded  on  the  23rd  of  August  and 
the  management  and  technician  briefings  were  also  carried  out  on  that  day.  Program  opera- 
tions were  started  on  the  following  day. 

All  inspection  personnel  were  military.  Four  technicians  participated  in  the  program  and 
completed  3-1/2  inspection  tasks.  Three  of  the  technicians  were  Level  5 and  one  was  Level 
3. 


All  of  the  inspection  techniques  being  evaluated  were  normally  utilized  at  MacDill.  Pene- 
tront  was  used  for  approximately  o9%  of  the  inspections  conducted.  Eddy  current  was 
employed  for  about  19%  of  the  inspections,  x-ray  for  11%,  ond  ultrasonic  for  around  1%. 


Robins  Air  Force  Bose  (Depot) 


The  next  move:  was  to  Robins  Air  Force  Base,  Warner  Robins,  Georgia,  which  was  the 
fifth  and  last  Air  Logistics  Command  base  visited. 

The  trailer  was  moved  on  base  on  21  September  1977.  It  was  unloaded,  and  the  technician 
briefing  given.  The  management  briefing  was  given  during  the  following  day  and  prepara- 
tions were  made  for  the  program  operations  to  start.  The  structure  samples  and  equipment 
were  set  up  in  an  engine  test  facility  which  was  being  used  part-time  for  x-ray  work. 

Program  operations  started  on  26  September  1977. 

The  major  portion  of  the  NDI  technicians  at  Warner  Robins  ALC  work  the  midnight  to  8:00 
am  shift  because  of  their  heavy  x-ray  work  load.  The  remaining  technicians  work  on  either 
the  day  or  swing  shifts.  The  majority  of  program  participants  were  night  shift  employees  and 
performed  rheir  assigned  program  tasks  during  the  night  shift . 

All  technicians  were  civilians.  Fourteen  participated  in  the  program  and  completed  59 
inspection  tasks.  Of  these  technicians,  twelve  were  classified  as  Industrial  Radiographers, 
one  as  a Radiographer  Technician,  and  one  as  on  NDI  Specialist. 

All  inspection  techniques  were  utilized  by  the  participating  technicians,  but  radiography 
accounted  for  over  70%  of  the  inspections  normally  carried  out  by  them.  About  12%  of 
the  routine  inspections  were  penetrant  inspections,  with  ultrasonic,  eddy  current  surface 
probe,  and  eddy  current  bolt  hole  probe  accounting  for  5 to  6%  each. 

The  program  wns  completed  at  Warner  Robins  ALC  on  28  October  1977.  The  weather  was 
generally  mild  during  the  visit  to  this  facility. 

Charleston  Air  Force  Base 

The  program  was  transferred  from  Warner  Robins,  Georgia  to  Charleston,  South  Carolina. 
Charleston  Air  Force  Base  was  the  fourth  and  last  MAC  base  to  participate  in  the  program. 

The  trailer  was  moved  on  base  on  2 November  1977.  It  was  unloaded  that  day  and  the 
technician  briefing  was  given.  The  management  briefing  was  scheduled  to  be  given  on  the 
following  day,  but  the  next  morning  it  was  postponed  until  the  following  week.  Program 
operations  were  started  on  3 November,  however. 

All  samples  and  equipment  were  set  up  in  the  NDI  shop  which  was  located  in  a large  building 
with  other  shops  and  offices.  The  NDI  shop  was  a large,  long,  open  room  with  overhead 
doors  at  one  end  that  opened  outside  onto  a concrete  drive. 

The  NDI  shop  chief  was  a civilian  and  the  participating  technicians  were  both  military  and 
civilian.  Six  technicians  participated  in  the  program  and  completed  8 inspection  tasks. 

One  technician  was  Level  3,  four  were  Level  5,  and  one  was  Level  7.  One  of  tlie  Level  5 
technicians  had  participated  in  the  program  at  George  AFB  in  July  of  1976.  During  the  past 
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year  he  transferred  to  Charleston  AFB  where  he  had  the  opportunity  to  participate  in  the 
program  a second  time  . 

Charleston  AFb  normally  utilized  all  the  NDI  techniques  being  evaluated,  including  the 
Gulton  automatic  bolt  hole  instrument.  The  major  portion  of  their  inspection  jobs  involved 
the  use  of  the  penetrant  technique,  which  accounted  for  slightly  over  50%  of  the  inspec- 
tions performed.  Eddy  current  surface  probe  inspections  amounted  to  approximately  26% 
of  the  inspec'ions  done,  and  ultrasonic  inspections  accounted  for  obout  16%  of  the  in- 
spections. Ecdy  current  bolt  hole,  eddy  current  bolt  hole  automatic  and  x-ray  each  ranged 
from  1 to  3%. 

The  program  was  completed  at  Charleston  on  2 December  1977.  The  weather  in  Charleston 
was  generally  mild  during  the  month  and  some  rain  occurred. 

Shaw  Air  Force  Base 

The  trailer  was  transported  to  Shaw  Air  Force  Base  in  Sumter,  South  Carolina.  Shaw  AFB 
was  tF>e  fourth  T AC  base  to  participate  in  the  program,  and  was  the  final  base  on  the  pro- 
gram schedule . 

TFie  trailer  was  brought  on  base  on  7 December  1977  and  unloaded  at  the  NDI  shop.  The 
management  briefing  was  presented  the  following  day  and  the  equipment  was  set  up  for 
program  operations  to  begin  on  12  December. 

The  NDI  slop  had  tlie  typical  TAC  design.  All  equipment  was  set  up  inside  the  building 
and  the  trailer  was  parked  outside. 

All  participants  at  Shaw  AFB  were  military.  Nine  technicians  participated  in  the  program 
and  completed  12  inspection  tasks.  One  technician  was  Level  3,  five  were  Level  5,  and 
three  were  Level  7. 


Shaw  AFB  has  routinely  used  all  NDI  techniques  under  evaluation  except  ultrasonic,  which 
is  seldom  required.  Penetrant  was  used  for  approximately  70%  of  the  inspections  normally 
conducted  at  Shaw  AFB.  X-ray  was  used  for  approximately  15%,  and  eddy  current  surface 
probe  and  bolt  hole  probe  for  about  15%. 

The  program  was  completed  at  Shaw  on  13  January  1978.  The  weather  during  the  month 
was  cold  to  mild  with  some  rain  occurring. 


Summary 


From  16  June  1975  tc  13  January  1978,  the  program  was  taken  to  22  Air  Force  Bases,  in- 
cluding the  Dry  Run  at  Wrighf-Pafterson  (See  Figure  4-7).  All  5 AFLC’s  participated,  as 
well  as  4 ATC  bases,  4 MAC  bases,  4 SAC  bases,  and  4 TAC  bases.  Excluding  Wright- 
Patterson  AFB  participants,  almost  300  NDI  technicians  participated  in  the  program  and 
completed  approximately  300  separate  inspection  tasks.  This  represents  the  cumulative 
inspection  of  over  a half-million  potential  flaw  sites  (see  Figure  4-3). 
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After  completing  the  work  at  Shaw,  the  program  trailer  with  the  structure  samples  was 
returned  to  the  Lockheed-Georgia  Company  in  Marietta,  Georgia  to  conclude  all  program 
tasks.  The  program  had  been  on  the  rood  continuously  for  2 year*  and  3 months.  Total 
distance  traveled  during  that  time  was  50,  000  miles. 
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Figure  4-2.  Field  Data  Acquisition  Schedule 
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SECTION  V.  DATA  COLLECTED 


The  nucleus  of  all  the  NDI  reliability  data  acquired  in  this  program  is  composed  of  flaw  "find" 
or  "no  find"  information  for  each  cataloged  flaw  site  inspected  by  each  participant.  Flaw 
sites  cataloged  at  the  start  of  the  data  acquisition  phase  were  those  identified  as  suspect 
fatigue  cracks  of  lengths  estimated  initially  by  nondestructive  methods.  Subsequent  structure 
teardown  and  detailed  examination  at  the  conclusion  of  the  data  acquisition  phase  provided 
more  accurate  data  on  the  flaw  content.  Schedules  of  cataloged  flaws  which  were  identified 
at  the  beginning  of  the  data  acquisition  effort  are  listed  along  with  participant  identification 
numbers  for  each  structure  sampie/NDI  method  combination  in  Figures  5-1  through  5-16  in 
matrix  formats.  Entries  are  coded  with  a numeral  one  (1)  denoting  a find,  a zero  (0)  denoting 
a no-find,  and  a dash  (-)  indicating  that  the  individual  did  not  exomine  that  particular  flaw 

i 

Data  summaries  are  provided  at  the  bowom  of  each  column  and  at  the  end  of  each  row. 

Column  summaries  provide  the  total  number  of  false  calls  (F)  by  each  technician,  the  ratio  of 
finds-to-total  flaw  count  (x/N)  and /hat  ratio  in  percent  (%).  Row  summaries  are  given  on 
the  final  page  of  each  figure  in  term!  of  total  finds  ratioed  to  total  number  of  technicians 
( 1 /n)  and  that  ratio  in  percent  (%)|  Cataloged  suspect  flaw  locations  which  were  not  sub- 
sequently confirmed  as  containing  cJacks  after  teardown  are  coded  with  an  asterisk  (*).  The 
post-teardown  flaw  information  whif  h is  corrected  for  size  error  is  provided  in  Section  VII, 
"Teardown  Evaluation"  and  is  empllyed  in  the  final  data  analysis  contained  in  Sections  X and 
XI,  The  flaw  identification  (ID)  nfmbers  which  are  listed  on  the  above  figures  are  the  ones 
used  in  the  data  acquisition  phase  fcf  the  program.  The  same  flaws  are  listed  with  crack 
identification  numbers  in  Section  Jll,  using  prefix  and  suffix  modifications  to  the  basic  iden- 
tification numbers  listed  in  this  section.  For  example,  flow  number  77a  in  Figure  5-1  is 
identified  as  crack  number  A277/sPn  Figure  7-5.  This  change  was  incorporated  to  facilitate 
computerized  data  storage  and  retrieval . 

A large  quantity  of  additional  raw  data,  in  both  numerical  and  narrative  form,  was  collected 
but  the  volume  exceeds  the  limits  of  convenient  presentation  in  this  report.  The  categories 
for  the  additional  data  are  as  follows: 

o Facility  Evaluation 
o Daily  Log 

o Equipment  Performance 
o Technician  Profile 
o Inspection  Log  (equipment  settings) 

The  detailed  content  within  each  category  is  presented  in  Figures  8-1  through  8-7  in  Section 
VIII,  Data  Storage  and  Retrieval  and  as  it  was  originally  formatted  on  raw  data  sheets  in 
Figures  5-17  through  5-29. 
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FIGURE  5-1  . RAW  DATA  SHEET  - SAMPLE  A,  EDDY  CURRENT  SURFACE 
SCANS 
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FIGURE  5-6.  RAW  DATA  SHEET  - SAMPLE  B,  RADIOGRAPHIC  NDI 
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FIGURE  5-9.  RAW  DATA  SHEET  - SAMPLE  D,  ULTRASONIC  SHEAR  WAVE 
SCANS  (Continued) 
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FIGURE  5-9,  RAW  DATA  SHEET  - SAMPLE  D,  ULTRASONIC  SHEAR  WAVE 
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FIGURE  5-10.  RAW  DATA  SIIFET  - SAMPLE  D,  MANUAL  EDDY  CURRENT 
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FIGURE  5-10,  RAW  DATA  SHEET  - SAMPLE  D,  MANUAL  EDDY  CURRENT 
BOLT  HOI  E SCANS  (Continued) 
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FIGURE  5-11  . RAW  DATA  SHEET  - SAMPLE  D,  EDDY  CURRENT  BOLT  HOLE 
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FIGURE  5-12.  RAW  DATA  SHEET  - SAMPLE  E,  MANUAL  EDDY  CURRENT  BOLT 
HOLE  SCANS 
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FIGURE  5-14.  RAW  DATA  SHEET  - SAMPLE  E,  MANUAL  EDDY  CURRENT  BOl  T HOLE 
SCANS  (Continued) 
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TECHNICIAN  PROFILE  FORM 


. Assigned  A/F  Identification  No. 


2.  Dote 


3.  Job  Title/AFSC 


4,  Education- 


Grade  School-High  School:  No.  of  Years 


College:  No.  Years 


NDI  Training 


Graduate 


Dotes  (Mo.-Yr.) 


Graduate 


Major 


No.  Hours 


5.  NDI  Experience: 

(A)  How  Long  have  you  been  in  NDI? 


Mthi. 


(B)  How  many  inspections  per  month  do  you  perform  on  Engine  Parts  (E)  and  Aircraft 
Structure  (A/C)? 

Ultrasonic:  (E)  (A/C)  ; Eddy  Current  (Surface  Probe):  (F) 

(A/C)  ; Eddy  Current  (Bolt  Hole  Probe-Manual):  (E)  (A^C)  ; 

Eddy  Current  (Bolt  Hole  Probe- Automatic):  (E)  (A/C)  ; 

Penetrant:  (E)  (A/C)  ; X-ray:  (E)  (A/C) 

6.  Job  History  (Start  with  most  recent  job  and  work  backward  - Estimate  dates  if  actual 
j dates  unknown) 


(A)  F rom 


Job  Title 


Page  I of  2 


EQUIPMENT  PERFORMANCE  CHECK 

X-RAY 

(1) 

Air  Force  Base 

(2) 

Stepwedge  No . 

(3)  Date 

(4)  Lockheed  Rep/AF  NDI  Technical  ID  No. 

— 

(5)  Equipment/Material  Used: 
X-ray  Equip  . Mfg  . 

Film  Mfg  . 


Model 

Type 


Serial  No . 


Developer  Test  Strip  Mfg. 

Chemiccls 

Devt  loper 
Stop  Bath 
Fixer 

Hypo  E I iminator 
Wetting  Agent 


Mfg  . 


Back  ing 

.Type 

Type 


(6)  Techniques  Parameters: 

FFD  KV 


MA 


Time 


Process: 


Hand 


Automatic 


Processing 

Information : 

Hand 

Developer 

Time 

Temp 

Mfg  - 

Stop  Bath 

Time 

Temp 

Serial  No  . 

1 ixer 

Time 

Temp 

Time 

Hypo  Eliminator  Typt 

Automatic 
Modo  I 


Temp . 


Wash 


Time 


Temp 


Wetting  Agent  Type 


f IGURE  5-20 


5-5  5 


EQUIPMENT  PERFORMANCE  CHECK 
FLUORESCENT  PENETRANT 


r 


y 
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klXtlSW! 


EDDY  CURRENT 


(2)  Calibration  S td . ID  No,  (3)  Date  (4)  Lockheed  Rep/AF  NDI  Technician  ID  No, 


(5)  Equipment/Materials  Used:  ( ) Surface  Probe  ( ) Bolt  Hole  Probe 

( ) Automatic  Bolt  Hole  Probe 


Instrument  Mfg  . 
Transducer  Mfg . 


(6)  Equipment  Settings: 


Balance 


Model 


Model 


Serial  No. 


Stock  No. 


Lift-off/Freq. 


(For  Autocratic)  Strip  Chart  Speed 
Speed 


Range 


Probe  Rotation 


Probe  Advance  for  Revolution 


(7)  No.  Microvolts  Deflection  using  Calibration  Stc'. 


(8)  Comments: 


FIGURE  5-22 
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EQUIPMENT  PERFORMANCE  CHECK 
ULTRASONIC 


Page  1 of  2 


(1)  Air  Force  Base 

(2)  Date  (3)  Lockheed  Rep/lnspector  ID  No.  (A/F) 

(4)  Equipment/Materia!  Used: 

Mfg. Model Serial  No. 

Transducer  (Freq.,  Angle,  Size,  Mfg . and  Serial  No. 


i 

I 
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FIGURE  5-23  (Continued) 


NONDESTRUCTIVE  INSPECTION  DATA 
ULTRASONIC 


! (1)  Air  Force  Base 


(?) 

Assigned  AF  NDI  Technician  ID  No. 

(3)  Date 

(4)  Sample  Identification 

(5) 

Equipment/ Material  Used: 

Ultrasonic  Inst.  Mfg. 

Model 

Serial  No. 

Model 

Serial  No. 

Transducer  Mfg. 

Model 

Serial  No. 

Freq.  Angle 

Size 

Couplant 

(6) 

Inspection  Procedure  Identification: 

Calibration  Std . ID  No. 

(7)  Equipment  Calibration  Settings: 

Sweep Pulse  Length Frequency 

Reject Test  Mode  Pulse  Echo 

Sensitivity Damping 

Other  (Record  under  Comments) 


(8)  Inspection  S tart/S  top  Times  (Date  if  after  Item  3 Date) 

Start  Stop  Start  Stop 


(9)  Inspector  Comments  (Equipment  Adjustments,  Inspection  Procedure  Variations,  Other 

Comments) 


NONDESTRUCTIVE  INSPECTION  DATA 
FLUORESCENT  PENETRANT 


(I)  Air  Force  Base 


(2) 

Assigned  A/F  NDI  Technician  ID  No. 

(3)  Date 

(4)  Sample  No. 

(5) 

Equipment/Material  Used: 

Penetrant  Type 

Group 

Material  Manufacturer 

Commercial  Designation 
or  Trade  Name 

Penetrant 

Developer  

Cleaner  

(6)  Inspection  Procedure  Identification: 


(7)  Method  of  Application: 
Dwell  Times: 


Penetrant 


Developer 


(8)  Inspection  StartAtop  Times  (Date  if  after  Item  3 date): 


Stop 


Start 


Stop 


Start 


t 


NONDESTRUCTIVE  INSPECTION  DATA  - FLUORESCENT  PENETRANT 


Page  2 ol  2 


(9)  Inspector's  Comments:  (Material/t  quipment  Adjustments,  Inspection  Procedure 

Variations,  Other  Comments) 


FIGURE  5-25  (Continued) 


i 

s 


t 
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Page  1 of  2 


NONDESTRUCTIVE  INSPECTION  DATA 
RADIOGRAPHIC  (X-RAY) 


(2)  Assigned  A/F  NDI  Technician  ID  No.  (3)  Date  (4)  Sample  Identification 


(5)  Equipment/Matericls  Used: 


X-Ray  Equip.  Mfg. 
Film  Mfg . 


Model 


Serial  No. 


Loading:  ( ) Single  ( ) Double 


Film  Type:  No.  1 (next  to  sample)  ; No.  2 


Pack  Size 


Screens 


Backing 


(6)  Inspection  Procedure  Identification 


(7)  Technique  Parameters: 

FFD/Tube  to  Aiming  Point 
Automatic  Process: 
Developer  Temp 


Hand  Process: 


Developer  Temp Developer  Time Temp 

Stop  Bath  Time Temp_ 

Fixer  Time Temp 

Hypo  Eliminator  Type 

Wash  Time Temp 

Wetting  Agent  Type 

Density  Range  in  areas  to  be  inspected 


(8)  Inspection  Start/Stop  Times  (Date  if  after  Item  3 Date) 
Start  Stop  Start 


_StO£ 


NONDESTRUCTIVE  INSPECTION  DATA-  RADIOGRAPHIC  (X-RAY) 


Page  2 of  2 


(9)  inspector  Comments:  (Equipment  Ad  justments,  Inspection  Procedure  Variation, 

Other  Comments) 


| NONDESTRUCTIVE  INSPECTION  DATA 

EDDY  CURRENT  (SURFACE  PROBE) 

(1)  Air  Force  Base 

(2)  Assigned  A/F  NDI  Technician  ID  No. 

(3)  Date 

(4)  Sample  Ident.  & Po  ition 
( ) Sample  A 
( ) Sample  B,  Overhead 
( ) Sample  B,  Below 

(5)  Equipment/Malerial  Used: 

5 toe 

Eddy  Current  Inst.  Mfg. Model  Seri 

Probe  Mfg. Model Sto< 

(If  shoe,  holder,  jig  or  probe  fixture  is  used,  describe  under  "Comments" 


(6)  Inspection  Procedure  Identification: 

Calibration  Std.  ID  No. 


Stock  or 
Serial  No 

Stock  No 


(7)  Equipment  Calibration  Settings: 

Ba  lance Li  f t-off  /Freq . 


(8)  Inspection  StartAtop  Times  (Date  if  after  Item  3 Date) 
Start  Stop  Start 


Range 


(9)  Inspector’s  Comments:  (Equipment  Adjustment,  Inspection  Procedure  Variation, 

Other  Comments) 


FIGURE  5-27 


m* 
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NONDESTRUCTIVE  INSPECTION  DATA 
EDDY  CURRENT  (BOLT  HOLE  MANUAL) 


(1)  Air  Force  Bose 


(2)  Assigned  A./F  NDI  Technicion  ID  No.  (3)  Dote  (4)  Sample  Identification 


(5)  Equipment/Material  Used: 

Eddy  Current  Inst.  Mfg . 
Probe  Mfg  . 


Model 


Stock  or 
Serial  No. 

Stock  No. 


(6)  Inspection  Procedure  Identification: 


Calibration  Std.  ID  No. 


(7)  Equipment  Calibration  Settings: 


Balance 


Lift-off  /F  re  q , 


Range 


(8)  Inspection  S tart/S  top  Times  (Date  if  after  Item  3 Date): 

Start  Stop  Start 


(9)  Inspector's  Comments:  (Equipment  Adjustments,  Inspection  Pr ocedure  Variations, 

Other  Comments) 


NONDESTRUCTIVE  INSPECTION  DATA 
EDDY  CURRENT  (BOLT  HOLE  AUTOMATIC) 


(1)  Air  Force  Base 


P) 

Assigned  A/F  NDI  Technician  ID  No. 

(4) 

Sample  Identification 

(5) 

Equipment/Materials  Used: 

Stock  or 

Eddy  Current  Inst.  Mfg  . 

Model 

Serial  No . 

Probe  Mfg . 

Model 

Stock  No . 

(6) 

Inspection  Procedure  Identification: 

L t 

Calibration  Std.  ID  No. 


(7)  Equipment  Calibration  Settings: 

Balance  Lift-off/Freq . Range 

Strip  Chart  Speed  Probe  Rotation  Speed 

Probe  Advance  per  Revoltion 

(8)  Inspection  S tart/Stop  Times  (Dote  if  after  Item  3 Date) 

Start  Stop  Start  Stop 


(9)  Inspector's  Comments:  (Equipment  Adjustments,  Inspection  Procedure  Variation, 

Other  Comments) 


SECTiONVI.  PROGRAM  ADDITIONS 


During  the  data  acquisition  phase  of  tlte  NDI  Reliability  Program,  which  lasted  for  over  two 
years,  certain  newly-developed  NDI  equipment  and  specially-fabricated  test  specimens  were 
added  to  the  program.  Automatic  eddy  current  bolt  hole  inspection  was  added  in  December 
of  1976  so  that  compaiisons  could  be  made  between  the  newer  automatic  techniques  and  the 
standard  hand-held  eddy  current  bolt  hole  technique.  A newly  developed  ultrasonic  rotational 
surface  scanner  was  also  added  in  December  of  1976  to  measure  the  potential  improvement  in 
inspection  reliability.  Finally,  a group  of  76  Technician  Proficiency  Screening  Samples 
recommended  by  the  Steering  Committee  in  January  1977  were  added  in  July  of  1977  to  deter- 
mine if  o relatively  simple  small  inspection  sample  could  be  used  to  evaluate  or  predict 
technician  NDI  ability  on  larger  more  complex  structure.  The  automatic  bolt  hole  technique 
was  applied  to  program  Samples  D,  E,  and  F and  the  ultrasonic  instrument  was  applied  to  pro- 
gram Sample  A.  Standard  manual  ultrasonic  and  eddy  current  bolt  hole  NDI  techniques  were 
applied  to  the  screening  samples,  designated  as  a new  Sample  Group  G. 

AUTOMATIC  EDDY  CURRENT  BOLT  HOLE  INSPECTIONS 


Two  Gulton  FD-100  outomatic  eddy  current  bolt  hole  inspection  instruments  were  obtoined 
for  use  in  evaluating  the  automatic  bolt  hole  technique  during  the  on-going  NDI  Reliability 
Program.  The  Gulton  unit  (see  Figure  6-1)  is  composed  of  the  following  major  assemblies: 

A . Motorized  Scanner 

B.  Eddy  Current  Amplifier 

C.  Signal  Conditioning  Circuitry 

D.  Analog  Recorder 

E.  Scanning  Probes  and  Mounting  Hardware 

The  motorized  scanner  rotates  an  eddy  current  bolt  hole  probe  at  a controllable  rate  from 
approximately  10  rpm  to  100  rpm.  As  the  probe  rotates,  it  spirals  in  the  forward  or  reverse 
directions.  Longitudinal  probe  travel  is  0.025"  per  revolution,  or  40  revolutions  per  inch. 
Probe  travel  is  controllable  and  maximum  travel  is  1-1/2". 

During  a scan  of  a fastener  hole,  the  eddy  current  amplitude  output  is  filtered  to  enhance 
the  flaw  signal  as  it  is  transmitted  to  the  analog  recorder.  As  on  alternative,  the  signal  can 
be  viewed  on  an  auxiliary  oscilloscope  and  then,  if  flaw  indications  are  seen,  the  signal  can 
be  recorded  by  the  analog  recording  during  anof!>er  pass  of  the  probe  through  the  hole.  The 
recorded  data  can  be  examined  to  determine  flaw  length,  depth  and  width. 

A procedure  document  titled  "Self  Introduction  for  Automated  Eddy  Current  Scanning  System" 
and  on  Operational  Supplement  to  the  NDI  Reliability  Program  Technical  Manual  (see 
Appendix  A)  were  prepared  for  use  in  implementing  this  addition.  Calibration  standards 
and  two  technician  practice  specimens,  as  shown  in  Appendix  A,  were  also  prepaied. 
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The  fwo  practice  samples  were  test  panels  that  were  built  up  ond  structurally  evaluated  in 
other  programs.  They  were  selected  for  use  in  this  program  because  of  their  existing  fatigue 
crack  population  and  similarity  to  samples  already  contained  in  the  program.  One  was  a 
spanwise  splice  test  panel  and  the  other  was  a center  wing  cap,  riser-to-web  test  panel . 

Each  was  about  four  feet  long  and  each  contained  a number  of  cracked  holes.  Two  standards 
were  prepared  for  use  in  the  program.  One  was  a spanwise  splice  standard  and  the  other  was 
a cenier  wing  standaid.  Each  had  a 0.030  through  Elox  slot  in  one  bolt  hole. 

For  each  hole  in  the  practice  specimens  that  contained  a crack,  a copy  of  the  recorded 
analog  tape  was  reproduced  and  printed  in  the  procedure  document,  along  with  an  explana- 
tion of  the  recording  and  an  interpretation  of  the  recorded  signal.  Each  technician  was 
allowed  to  become  familiar  with  the  instrument  by  going  through  the  detailed  instrument 
setup  procedures  and  working  with  the  practice  specimens  for  as  long  as  necessary.  It  was 
felt  that  this  documentation  and  practice  period  was  necessary  as  most  of  the  installations 
visited  had  not  yet  received  the  automatic  eddy  current  equipment. 

This  automatic  eddy  current  part  of  the  program  was  initiated  in  December  of  1976  at  Dover 
AFB,  Delaware.  However,  some  automatic  bolt  hole  inspections  had  been  accomplished 
previously  at  McClellan  in  September  and  October  of  1976  using  their  own  equipment  (see 
Figure  4-3  for  bases  participating  in  the  various  parts  of  the  program). 

The  automatic  eddy  current  bolt  hole  program  was  generally  well  received  by  the  Air  Force 
technicians.  Most  all  had  l*eard  of  the  Gulton  unit  and  were  interested  in  having  the  oppor- 
tunity to  become  familiar  with  it. 

The  inspection  results  acquired  with  this  unit  will  perhaps  improve  somewhat  as  the  Air  Force 
technicians  become  more  familiar  with  the  unit,  and  particularly  with  the  interpretation  of 
the  analog  data. 

ULTRASONIC  ROTATIONAL  SCANNER  INSPECTIONS 


A manual  adaptation  of  the  AFML/Boeing  ultrasonic  rotational  scanner  system  was  developed 
at  the  San  Antonio  Air  Logistics  Center  for  use  in  the  detection  of  radial  cracks  around  fastener 
holes  (see  Figure  6-2).  The  system  consisted  of  an  ultrasonic  instrumentand  rotational  scanner 
assembly  that  contained  two  transducers. 

The  scanner  head  assembly  consisted  of  (1)  three  adjustable  legs,  (2)  a centering  device  for 
positioning  the  transducers  around  the  fastener  head,  (3)  an  adjustable  transducer  holder,  and 
(4)  a transducer  assembly.  The  transducer  holder  was  adjustable  for  alignment  of  the  transducer 
sound  beam  to  the  edge  (circumference)  of  the  hole.  The  holder  was  adjustable  in  three 
directions;  tangential,  radial,  and  angular.  These  adjustments  allowed  the  operator  to  direct 
a shear  wave  to  tho  base  of  the  countersink.  The  tangential  adjustment  moved  the  transducer 
assembly  toward  and  away  from  the  fastener  bole.  The  radial  adjustment  moved  the  transducer 
assembly  to  the  right  or  left  of  the  fastener  hole.  The  angle  was  adjustable  using  a template 
to  set  it  at  the  desired  angle  for  sound  entry  into  the  part.  This  adjustment,  once  set,  was 
fixed  and  could  not  be  continuously  adjusted  in  order  to  maximize  the  signal  response. 
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ROTATING  K NOB 


transdicer  assembly 


Figure  6-?.  Ultrasonic  Rotational  Scanner 


Flu'  transducer  assembly  consisted  of  a transducer,  a transducer  sleeve,  water,  and  a flexible 
boot  (see  Figure  6-2).  Tire  transducer  assembly  screwed  into  the  transducer  holder.  A water 
column,  confined  by  means  of  tlx;  transducer,  transducer  sleeve  and  flexible  boot  transmitted 
the  sound  through  the  rubber  boot  to  the  test  piece.  Use  instrument  utilised  with  th  > manual 
scanner  head  assembly  was  an  Automation  Industries  UM775D  with  a AG1FM  Timer  and 
I0NRF-VDB  Pul  sc  i 'Receiver. 

A detailed  proceduio  and  an  Operational  Supplement  to  the  NDI  Reliability  Program  Technical 
Manual  were'  provided  for  set-up,  calibration,  and  use  with  the  supplied  practice  samples  and 
structure  Sample  A (see  Appendix  B).  A calibration  standard  and  practice  samples,  as  shewn 
in  Appendix  B,  were  also  provided  with  the  scanner  head  and  ultrasonic  instrumentation.  Both 
the  standard  and  practice  samples  were  pieces  of  C-130  wing  box.  The  standard  had  one 
fastener  removed  cod  a sawcut  made  in  that  fastener  hole  for  calibration  purposes.  The  prac- 
tice samples  weie  selected  for  their  crack  population  and  all  fasteners  were  left  in  the  installed 
configuration . Technicians  were  allowed  to  become  familiar  with  the  instrument  and  work  with 
the  practice  samples  as  long  as  each  felt  necessary.  After  they  were  familiar  with  its  operation, 
each  was  assigned  to  inspect  structure  Sample  A. 

Although  the  inspection  technique  worked  well,  when  all  adjustments  were  properly  made, 
much  difficulty  was  encountered  by  the  technician  in  getting  the  rotational  scanner  properly 
adjusted.  Unfortunately,  most  technicians  found  the  task  too  difficult  and  did  not  progress 
beyond  the  practice  sample  portion  of  the  program,  so  only  four  Sample  A inspections  were 
completed.  Some  of  the  specific  problems  encountered  were  as  follows: 

Installing  water  into  the  transducer-sleeve-boot  assembly  without  trapping  air 
bubbles. 

Adjustment  of  the  liolder  in  the  tangential-radial-angular  directions  for  both 
transducers . 

Proper  adjustment  of  the  threo  legs  so  tlrat  both  boots  were  in  proper  contact 
on  the  entire  surface  as  the  scanner  head  war  rotated. 

Boots  coming  off  during  inspection. 

Those  few  with  patience  did  get  the  instrument  set  up  and  operational;  liowever,  the  inspection 
of  structure;  Sample  A took  considerably  longer  with  the  rotational  scanner  than  by  using  the 
standard  hand  scan  technique. 

NDI  PROFICIENCY  SCREENING  SAMPLE  PROGRAM 

This  program  was  designed  to  determine  if  it  is  possible  to  measure  nondestructive  inspection 
capability  using  small  flat  panels  as  testing  samples  either  than  actual  built-up  aircraft 
structures.  The  program  consisted  of  a technical  activity  in  which  flat  panels,  prepared  in  the 
laboratory  with  known  defeats,  were  incorporated  into  the  on-going  NDI  Reliability  Program. 
Those  panels,  alone;  with  tee  typical  aircraft  structures  that  already  existed  in  that  program, 
were  inspected  in  depot  and  field  NDI  installations.  The  NDI  reliability  data  collected  using 
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the  flat  panels  have  been  statistically  compared  to  the  data  collected  for  the  actual  structures 
to  test  for  significant  correlations  between  the  two  (see  Section  XI). 

Fabrication  of  Flat  Panels 


Seventy-eight  specimen  blanks  nominally  two  inches  by  sixteen  inches  were  machined  from 
0.20  inch  thick,  bare  7075-T651  aluminum  alloy  sheet.  Each  blank  was  uniquely  serialized 
and,  as  subsequently  described,  all  blanks  ultimately  contained  ten  fastener  holes  to  provide 
a total  of  780  hales.  Fatigue  ,-iacks  were  initiated  and  grown  beside  a total  of  123  holes, 
and  four  different  nominal  crack  length  intervals  were  employed;  0. 050" -0. 100",  0.101"- 
0.175",  0 . 1 76"-0.?5C;',  and  0.251"-0.350"  . Crack  length  and  location  were  randomly 
distributed  within  three  different  groups  as  follows:  Each  blonk  having  a serialization  prefix 
"A"  hod  one  cracked  hoie,  each  prefix  "B"  blank  had  two  cracked  holes,  and  each  prefix  "C" 
biank  had  three  cracked  holes.  A fourth  group,  "D",  either  had  no  cracked  holes  or  had 
electrical-discharge-machined  (EDM)  flaws  for  use  in  calibration. 

All  blanks  weie  profiled  from  a single  skin  quality  sheet  and  serialized  on  one  end  using  on 
impression  stamp.  A drill  fixture  was  fabricated  having  provision  to  Iso  I d the  specimen  securely 
while  drilling  Ftoles  precisely  at  the  desired  locations.  Use  of  the  fixture  expedited  the  drilling 
operation  as  well  as  assuring  likeness  of  specimens.  Each  drilling  location  on  the  fixture  was 
numbered  and  each  specimen  was  placed  on  the  fixture  with  the  same  orientation  with  respect 
to  its  serialization  location.  Each  hole  requiring  a crock  wos  then  pilot  drilled  to  7/64-inch 
diameter  while  the  remaining  hole  positions  were  not  drilled  to  prevent  the  possibility  of 
generating  undesired  cracks  during  fatigue  cycling. 

Beginning  with  tl*e  "A"  specimens  requiting  only  one  cracked  hole,  each  specimen  was 
mounted  on  a 75,  000-pound  capacity  MTS  closed-loop,  electio-hydroulic  servo-controlled 
testing  system  equipped  with  hydraulic  self-oligning  grips. 

With  rhe  specimen  mounted  in  the  testing  machine  at  zero  load,  a starter  flaw  wos  cut  on  the 
hole  wall.  A thru  flaw  of  appioximately  0.02-inch  in  length  was  introduced  so  that  during 
final  reaming,  the  starter  flaw  could  be  completely  removed.  A jewelers  saw  was  used  to 
make  the  cut  and  care  was  taken  to  assure  thru-tbe-thickness  symmetry.  The  natural  crcck 
was  initiated  and  grown  using  a maximum  for  field  stress  of  i5.0  ksi,  o stress  ratio  (R)  of  -t  C . 1 , 
and  a cyclic  frequency  of  10  Hz.  This  selection  produced  a crack  that  had  the  desired  visual 
obscureness  with  respect  to  crack  path  plasticity  and  did  so  in  a reasonable  number  of  cycles. 
Crack  growth  was  monitored  using  a high  intensity  light  and  a thirty-power  binocular  micio- 
scope . Cycling  was  stopped  when  the  crack  reached  a predetermined  length  which  would  pro- 
vide the  desiied  flaw  size  after  final  ream.  Accurate  records  wre  kept  on  the  number  of 
cycles  required  for  crack  initiation  and  total  cycles  required  to  attain  each  desired  length  as 
exhibited  in  Figure  6-3.  The  cycle  initiation  data  generally  represent  cycles  required  to 
produce  o natural  crack  approximately  0.010  inch  long. 

Data  acquired  from  the  single  flaw  specimens  were  used  to  establish  procedures  for  the  multiple 
flaw  specimens  requiring  different  flaw  sizes  in  the  same  specimen.  For  these  cases,  a starter 
flow  was  firs*  made  for  the  longest  desiied  crack.  After  a predetermined  number  of  cycles, 
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All  Fatigue  Cycling  as  Follows: 


Max  Stress  - 15.0  K SI 

Stress  Ratio  (R)  = -*0.1 

Frequency  = 10  Hz 

Environment  = Room  Air 


Specimen 

Position 

Cycle*  to 

Number 

Number 

Initiation 

A1 

4 

4000 

A2 

1 

3500 

A3 

6 

3500 

A4 

9 

4500 

A5 

6 

3000 

A6 

1 

3000 

A7 

1 

4000 

A8 

9 

4000 

A9 

0 

3000 

A10 

2 

4000 

All 

9 

3000 

A12 

0 

3000 

A13 

7 

3000 

A14 

3 

3000 

A15 

3 

3000 

A16 

8 

3000 

A17 

6 

2500 

A18 

7 

3000 

A19 

2 

3000 

A20 

0 

3000 

A21 

3 

3000 

A22 

2 

3000 

A23 

4 

4000 

A24 

0 

3500 

A25 

5 

4000 

A26 

2 

3500 

A27 

8 

3500 

B) 

3 

3000 

6 

3000 

B2 

3 

4000 

4 

3000 

B3 

9 

3000 

2 

3500 

Figure  6-3.  NDI  Specimen  Fatigue  History 


Total 

Cycles 

23000 

14000 

1°000 

24000 

16900 

16000 

16500 

24000 

25500 

23000 

11000 

16000 

21000 

11000 

24000 

13000 

25000 

22000 

11000 

21000 

12000 

23500 

28000 

17500 

21000 

29000 

24000 

19000 
16000 
1 1000 
19000 
18000 
18000 
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Specimen 

Number 

B4 

B5 

B6 

B 7 

B8 

B9 

BIO 

B11 

B 1 2 

B13 

B14 

B 1 5 

B16 

B17 

B 1 8 

B19 

B20 

B21 

B22 

B23 


Position 

Number 

0 

3 
7 
9 

4 
2 
0 

7 
1 

3 

9 

3 
6 

1 

4 

8 
1 

6 

4 

7 

2 

0 

7 

0 

3 

9 

6 

0 

6 

3 

7 

y 

3 

1 

7 

1 

3 
1 
6 

4 

Figure  6-3.  NDI  Specimen  Foti 


Cycles  to 

Total 

Initiation 

Cycles 

3000 

12000 

3000 

19000 

3000 

19000 

4000 

12000 

3500 

15000 

3000 

18000 

5000 

13000 

3000 

23000 

3000 

1900C 

3000 

16000 

3000 

16500 

3500 

16500 

4500 

18000 

3500 

22000 

3000 

21000 

3000 

21000 

3000 

16000 

3000 

22000 

3000 

20000 

3500 

23000 

3000 

13000 

3000 

24000 

4000 

18000 

3000 

24000 

3000 

25000 

300C 

19000 

4000 

24000 

3000 

24000 

3000 

11000 

4000 

22000 

3500 

10500 

3000 

18500 

3000 

17000 

4000 

14000 

3000 

23000 

4000 

25000 

3000 

24000 

3000 

18000 

3500 

13000 

3000 

24000 

ue  History  (Cont'd) 
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Specimen 

Position 

Cycles  to 

Total 

Number 

Number 

Initiation 

Cycles 

B24 

2 

3000 

11000 

9 

3000 

19000 

B25 

5 

3000 

15000 

6 

3000 

26000 

B26 

5 

3000 

15000 

3 

3000 

15000 

B27 

0 

3000 

19000 

2 

3500 

21000 

B28 

5 

3500 

12000 

9 

3000 

23000 

B29 

0 

3000 

11000 

3 

3000 

14000 

B30 

6 

3000 

14000 

0 

3000 

17000 

B31 

2 

3000 

15000 

0 

3000 

19000 

B32 

4 

3000 

20000 

2 

3500 

23000 

B33 

0 

3500 

18000 

7 

3500 

15000 

Cl 

7 

4000 

19000 

2 

3000 

19000 

5 

3000 

22000 

C2 

3 

3000 

15000 

9 

3000 

22000 

0 

3000 

15000 

C3 

6 

3000 

23000 

2 

3500 

16000 

5 

3000 

16000 

C4 

2 

3000 

17000 

8 

3500 

17000 

5 

3500 

20000 

C5 

4 

3000 

25000 

3 

3500 

22000 

6 

3000 

16000 

C6 

1 

3500 

18000 

3 

2000 

18000 

5 

3500 

25000 

Figure  6-3.  NDI  Specimen  Fatigue  History  (Cont’d) 
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position 

Number 


Cycles  to 
Initiation 


Total 

Cycles 


Specimen 

Humber 

C7 

C8 

C9 

CIO 


6 

9 

4 

9 

0 

2 

1 

7 

8 
0 
2 
1 


3000 

3500 

3000 

3000 

3500 

4000 

3000 

3500 

3000 

3000 

3500 

3000 


21000 

18000 

23000 

24000 

19000 

21000 

16000 

25000 

26000 

26000 

26000 

26000 


ftic*  next  starter  flaw  was  cut  and  so  on.  The  result  was  different  numbers  of  cycles  applied 
to  each  starter  riaw  and  different  final  crack  lengths  on  the  same  specimen.  For  example, 
in  Specimen  B-20  in  Figure  6-3,  the  starter  flaw  was  cut  at  position  3 first.  After  3000 
cycles,  a starter  flaw  was  cut  at  position  1 . Tlie  result  was  two  different  final  crack  lengths 
as  shown  in  Figure  6-4. 

After,  all  specimens  were  cracked,  each  was  ogaio  placed  in  the  drill  fixture  and  the  remaining 
hole  positions  were  piloted  to  7/64  inch  diameter.  The  specimens  were  then  given  an  indepen- 
dent visual  inspection  to  verify  crack  locations  and  lengths.  Specimen  serialization  was  then 
masked  with  lead  tape  end  all  surfaces  were  primed  with  epoxy  and  given  a polyurethane  top- 
coat. All  holes  were  drilled  to  11/64  inch  diameter,  reamed  to  0,191  inch,  and  countersunk 
for  100  degree  3/16  inch  flush  head  HiLoks.  A detailed  specimen  drawing  and  condensed 
fabrication  sequence  are  presented  in  Figure  6-5. 

After  final  preparation  each  flaw  location  was  checked  to  confirm  that  the  flaw  could  not  be 
detected  with  the  unaided  eye  . All  raw  data  were  then  reduced  ro  yield  the  crack  growth 
history  data  in  Figure  6-3  and  the  crack  length/location  data  in  Figure  6-4.  The  data  are 
referenced  to  a specimen  orientation  with  *he  countersinks  facing  upward  and  the  stamped 
identifications  on  the  right-hand  end.  Fatigue  history  is  provided  in  Figure  6-3.  Surface 
roughness  of  both  bare  metal  and  epoxy  primed,  polyurethane  final  coated  panels  does  not 
exceed  64  RMS  finish. 

Data  sheets  for  technician  reporting  of  inspection  results  were  designed  for  graphic  depiction 
of  fatigue  cracks.  Figure  6-6  shows  a blank  data  form,  the  format  being  consistent  with  those 
used  on  the  basic  reliability  program.  Grading  of  data  sheets  were  accomplished  at  Lockheed- 
Georgia  using  the  tally  sheet  format  shown  in  Figure  6-7. 

ND!  Procedures 


NDI  procedures  commensurate  with  the  -36  manual  format  and  content  were  developed  for 
ultrasonic  shear  wave  and  eddy  current  bolt  hole  operations  on  the  screening  sample  panels. 
These  procedures  are  attached  as  Appendix  C.  Ultrasonic  shear  wave  scans  were  accomplished 
with  countersink  fasteners  in-place  and  eddy  current  bolt  hole  scans  accomplished  with  fasteners 
removed . 

Validation  of  Procedures  and  Test  Results 

Procedures  were  validated  by  engineering  personnel  before  assignment  to  technicians  in  the 
field  and  depot  environment.  Eddy  current  bolt  hole  scans  produced  significant  indications 
on  all  cataloged  fatigue  cracks.  No  ambiguous  indications  were  evidenced  from  non-f lowed 
holes,  due  to  the  high  quqlity  surface  condition  of  the  hole  walls. 

Ultrasonic  NDI  validation  was  conducted  in  detail  with  relative  echo  signal  amplitude  read- 
ings taken  on  each  fatigue  crack.  Instrument  operation  data  are  given  in  Figure  6-8  and 
results  ore  provided  in  Figure  6-9.  The  procedure  calls  for  the  instrument  gain  setting  to  80 
percent  of  full  screen  height  on  the  echo  obtained  from  a second  reflection  bounceO)  from  a 
0.05"  comer  slot  echo  (see  Figure  3,  page  7 of  Appendix  C).  This  setting  provided  a low 
level  response  from  fatigue  cracks  in  the  0.05"  to  0.12"  length  range  using  a direct  shot  at 


(1)  The  second  reflection  was  specified  to  keep  the  transducer  face  off  the  fastener  heod 
which  con  protrude  slightly  and  decouple  the  ultrasonic  energy  path. 
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NO!  SPECIMEN  SEE INITION; 


O'  INDICATES  CRACK  IN  DIRECTION  OF  SPECIMEN  OUTER  EDGE 
I"  INDICATES  CRACK  GROWN  IN  DIRECTION  OF  SPECIMEN  CENTER 

Figure  6-4.  Fatigue  Crack  Sizes  and  Locations  in  Flat  Panels 


CRACK  LENGTH,  INCHES,  AT  HOLE  NUMBER 


6-4.  Fatigue  Crack  Sizes 


CRACK  LENGTH,  INCHES,  AT  HOLE  NUMBER 


DM  CCR 


f ABRICATIO N SEQUENCE 

1)  Shear  Oversize  Blanks 

2)  Profile  Blanks  to  Above  Dimensions 

3)  Identify  Specimens  Using  Metal  Stomp 

4)  Pilot  Drill,  7/64-Dia.,  All  Holes  Requiring  Cracks 

5)  Cut  Starter  Flaws  (thru  flaw  approx.  0 .02-inch)  Using  Jewelers  Saw 

6)  Fatigue  Cycle  Until  Crack  Initiates  and  Reaches  Desired  length 

7)  Pilot  Remaining  Hole  locations,  7/64-Dia. 

8)  Mask  Specimen  Identification  Using  Lead  Tape 

9)  Prime  All  Surfaces  with  Epoxy  Plus  One  Coot  Polyurethane 

10)  Drill  All  Holes  11/64  Dia, 

1 1 ) Reom  al I Holes  0.191  Inch 

12)  Countersink  for  100-Degree  3/16-Inch  Flush  Head  Flilok 


Figure  6-5,  Specimen  Configuration  and  fabrication  Sequence 
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CricK  Markjtr Sample  ID 
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Figure  6-6.  Raw  Data  Form  for  Graphic  Depiction  of  Flaw  Locations  of  Flat  Panels 


PROFICIENCY  SCREENING  SAMPLES 


TEST  SITE  CLASS 

T6TAL 

CLASS  OPPORTUNITIES 

FINDS 

MISSES 

INSPECTOR  PROFIC.  LEVEL 

1 

32 

STRUCTURAL  TYPE 

II 

29 

INSPECTION  TYPE 

III 

30 

TEST  SITE 

IV 

32 

TECHNICIAN 

NDI  METHOD 

FLAW  CLASS 

1 

II 

III 

IV 

FALSE  ALARMS 

FLAW  SIZE 

.050 

.101 

.176 

.250 

RANGE 

.100 

.175 

.250 

.350 

SPECIMEN/HOLE 

NO. 


FIND  MISS 


SPECIMEN/HOLE 

NO. 


BI/3 

BI/6 

82/3 

B2/4 

B3/9 

B3/2 

B4/0 

B4/3 

B5/7 

B5/9 

B6/2 

B6/4 

B7/0 

B7/7 

B8/1 

BB/3 

09/3 

B9/9 

B10/6 

B 1 0/1 

Bll/4 

B 1 1/. 

B12/I 

B 1 2/ 6 

B13/4 

B13/7 

B 1 4/2 


FIND  MISS 


Figure  6-7.  Tally  Sheet  for  Grading  NDI  Response  on  Flat  Panels 
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PROFICIENCY  SCREENING  SAMPLES 


SPECIMEN/HOLE 

NO. 

m 

FIND 

MISS 

SPECIMEN/HOLE 

NO. 

m 

FIND 

MISS 

B14/0 

IV 

Cl/7 

n 

B15/0 

IV 

Cl/2 

ii 

BIS/7 

ii 

Cl/5 

in 

B 1 6/3 

IV 

C2/3 

i 

816/9 

II 

C2/9 

in 

81 7/6 

IV 

C2/0 

i 

817/0 

IV 

C3/6 

in 

818/6 

1 

C3/2 

i 

B 1 8/2 

IV 

C3/5 

B19/7 

1 

C4/2 

ii 

B 1 9/9 

III 

C4/8 

ii 

820/3 

II 

C4/5 

hi 

820/1 

1 

C5/4 

IV 

821/1 

IV 

C5/3 

II 

822/3 

III 

C5/6 

1 

822/1 

II 

C6/I 

1 

B23/6 

1 

C6/3 

B23/4 

IV 

C 6/5 

III 

B 24/2 

1 

07/ 6 

III 

824/9 

III 

C7/9 

825/5 

1 

C7./4 

IV 

82  5/6 

IV 

C8/9 

IV 

B26/5 

II 

C8/0 

II 

B26/3 

II 

C8/? 

III 

B27/0 

III 

C9/1 

1 

B27/2 

IV 

C9/7 

.V 

828/5 

1 

C9/8 

Mm 

B28/9 

IV 

Cl  0/0 

B29/0 

1 

Cl  0/2 

ma  ■ 

B29/3 

1 

Cl  0/1 

Mm* 

830/6 

1 

B30/0 

II 

831/0 

III 

B31/2 

1 

B32/2 

IV 

B32/4 

1 

B33/0 

IV 

833/7 

1 

Hi 

F igure  6-7 . 


Tally  Sheet  for  Grading  NDI  Response  on  Flat  Panels  (Cont'd) 
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NONDESTRUCTIVE  INSPECTION  DATA 
ULTRASONIC 


(1)  Air  Force  Base 
N/A 


(2)  Assigned  AF  NDI  Technician  ID  No. 
Sproot 


(3)  Date 
7/19 /77 


(4)  Sample  Identification 
Technician  Screening  Samples 


(5)  Equipment/ Material  Used: 

Ultrasonic  Inst.  Mfg.  Automation 


Transducer  M i. 


Automation 


Model  L)J  Serial  No.  10640-7 

Model Serial  No. 

Midel  57A3065  Serial  No.  271  46 


Freg.S.OMHz  Angle  60  A Size  1/4"  Sq . Couplant  Light  Oil 


(6)  Inspection  Procedure  Identification: 


Calibral  ion  Std  . ID  No. 


(7)  Equipment  Calibration  Settings: 

Sweep  0.5-5  Pulse  Length  10°  CW 


Video  F i Iter  Pos . 4 


Reject OFF 


Frequency  5.0  MHz 
Test  Mode  Pulse  Echo 


20db  Toggle 


.75  KHz  Repetition  Rate 


Sensitivity  14db(-l  Toggle)  Damping  None 


Other  (Record  under  Comments) 


(8)  Inspection  Start/Stop  Times  (Date  if  after  Item  3 Date) 
Start  Stop  Start 


Stop 


(9)  Inspector  Comments  (Equipment  Ad justments,  Inspection  Procedure  Variations,  Other 

Comments) 


Figure  6-8,  Ultrasonic  Instrument  Settings  for  Flaw  Echo  Amplitude  Readings 
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Figure  6-9.  Relative  Ultrasonic  Echo  Amplitudes  Obtained  from  Cataloged  Flov/s  in  Fiat  panels 


the  flow  and  an  unreliable  test  with  a second  reflection  bounce.  No  additional  gain  was 
called  for  in  spite  of  this  problem  because  of  the  prohibitive  baseline  noise  level  observed 
with  added  gain.  The  adjustments  to  obtain  80  percent  of  full  screen  height  on  the  cracks, 
as  presented  in  Figure  6-9,  are  listed  as  positive  values  wlrere  added  gain  was  required  to 
bring  the  signal  up  to  the  0.05"  corner  slot  reference  level.  Negative  values  indicate  the 
converse;  reduced  gain  requirements  to  obtain  80  percent  of  full  screen  height  on  larger 
flaws . 

A bare  (unpointed)  reference  panel  with  the  0.05"  (0.003"  width)  EDM  corner  slot  was  used 
as  the  ultrasonic  instrument  gain  reference.  Scheduling  constraints  precluded  its  being 
placed  into  ihe  painting  sequence  applied  to  the  rest  of  the  panels.  A plot  of  relative  gain 
versus  crack  length  in  Figure  6-10  reveals  the  combined  effect  of  paint  and  the  difference 
between  an  EDM  slot  and  actual  fatigue  cracks.  Cracks  in  the  0.05"  to  0.08"  length  range 
require  from  2 to  10  db  additional  gain  to  obtain  a signal  height  equivalent  to  the  0.05" 

EDM  slot.  The  plot  also  reveals  a good  deal  of  scatter,  especially  for  flaw  lengths  gieater 
than  the  panel  thickness  of  0.20".  Points  are  not  plotted  for  those  readings  accompanied  by 
on  asterisk  in  Figure  6-9,  since  they  are  for  direct  shors  at  the  flaw. 

Noise  amplitude  measurements  were  made  at  random  locations  on  the  panels  near  holes  with- 
out flaws.  In  all  cases,  the  noise  amplitude  did  not  exceed  10  percent  of  full  screen  lieight 
or  12.5  percent  of  the  0.05"  EDM  echo  reference  level  . 

Nondestructive  Inspection  of  Flat  Panels 


These  specimens  were  incorporated  into  the  NDI  Reliability  Program  at  Tinker  Air  Force 
Base,  Midwest  City,  Oklahoma,  in  July  1977,  and  inspection  data  were  obtained  there  and 
also  at  the  remaining  bases  in  the  program  consisting  of  MacDill  Air  Force  Base,  Robins  Air 
Force  Base,  Charleston  Air  Force  Ba-e,  and  Shaw  Air  Force  Base.  Technicians  found  these 
specimens  to  be  an  easy  and  straightforward  inspection  task.  Their  only  complaint  was  the 
fact  that  there  were  so  many  specimens  to  be  inspected. 

A total  of  25  ultrasonic  and  eddy  current  inspections  were  accomplished  during  !he  program. 
Inspection  results  and  comparisons  of  results  with  data  obtained  from  the  inspection  of  othei 
progrom  structure  samples  can  be  found  in  Section  XI. 

Since  flaw  lengths  were  accurately  mode  and  measured  when  these  specimens  were  con- 
structed, they  were  not  destroyed  to  obtain  flaw  length  measurements  as  was  necessary  with 
the  aircraft  structural  samples. 
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SECTION  VII.  TEARDOWN  EVALUATION 


The  purpose  of  the  teardown  examination  of  the  structure  samples  used  in  this  program 
was  to  accurately  determine  and  fully  characterize  their  flaw  content.  Flaw  indications 
were  initially  catalogued  and  length  estimates  made  in  the  planning  phase  of  the  program 
D;  careful  visual  and  eddy  current  examination.  The  teardown  inspection  provided  the 
following  additional  information: 

a)  direct  measurement  of  identified  flaws 

b)  confirmation  of  flaw  existence  at  locations  which  exhibited  high 
incidences  of  "false  calls" 

c)  discovery  of  additional  flaws,  unknown  in  the  planning  phase 

d)  elimination  from  the  list  of  flaws,  those  sites  which  exhibited  NDI 
indicctions  but  contained  no  actual  flaws 

The  sequence  of  tasks  which  composed  the  complete  teardown  examination  are  detailed 
in  the  following  sections  and  are  schematically  presented  in  Figures  7-1 A & 7-1 B. 
Chemical  processing  of  surfaces  to  enhance  detection  was  applied  to  all  samples.  The 
composition  and  application  data  for  the  chemical  agents  are  provided  in  Figure  7-2. 

Initial  Preparation 


Structure  samples.  Type  C,  were  excluded  from  teardown  because  they  were  machine 
grown  fatigue  cracks  under  closely  controlled  conditions.  The  size  and  shape  of  those 
flaws  are  therefore  known  with  sufficient  detail  for  analyses.  Structure  Samples  A,  B, 

E and  F were  totally  disassembled.  The  Sample  A portion  was  cut  from  the  intact  wing 
box,  rivets  sheared  off  at  the  buck  tail  and  skins  removed  from  stringers  in  three  pieces. 
Sample  B was  treated  in  the  same  manner  but  no  initial  cutting  was  required  due  to  their 
size.  Sample  D required  no  disassembly  and  Sample  E breakdown  was  achieved  by  un- 
bolting the  cracked  fittings  from  the  dummy  cover  plates.  Sample  F sections  were  cut  from 
the  total  box  beam  and  separated  into  spar  caps,  webs  and  web  stiffeners.  Point  was 
removed  from  all  structure  samples  with  Turco  5212  paint  stripper.  After  stripping,  the 
samples  were  cleaned  in  an  alkaline  solution,  water  rinsed,  dipped  in  an  acid  neutralizing 
bath,  water  flushed  and  oven  dried.  Photos  of  the  samples  after  the  clean  and  acid  dip 
operations  are  presented  in  Figures  7-3A  - 7-3E. 

Fluorescent  penefrant  inspections  were  performed  on  the  samples  with  Magnoflux  ZL-22A 
penetrant,  emulsified  with  ZR-10A,  water  washed,  air  dried  and  developed  with  Magnoflux 
ZP-13A.  The  penetrant  inspections  were  conducted  by  Lockheed-Georgia  Quality 
Assurance  Laboratory  personnel.  Flaw  indications  were  red  marker  identified  on  the  pieces 
at  all  suspect  locations.  Samples  A and  B were  also  inspected  further  with  a special  auto- 
matic eddy  current  surface  scanning  device,  developed  ot  Sacramento  ALC . Results  of  the 
penetrant  and  special  eddy  current  scons,  eleng  with  high  incidence  of  "false  calls" 
derived  from  the  field  data,  weie  added  to  the  list  of  flaw  suspect  locations. 
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REMOVE  TEST  SECTION  FROM  STRUCTURE 


PAINT  STRIP 


ALKALINE  CLEAN 


WATER  RINSE 


ACID  DIP 


WATER  RINSE  AND  OVEN  DRY 


PENETRANT  INSPECT 


RECORD  SUSPECT  FLAWS 


LAYOUT  AND  IDENTIFICATION  FOR  SECTIONING 


PHOTOGRAPH 


SECTION  INTO  INDIVIDUAL  LABORATORY  SPECIMENS 


CLEAN  WITH  MILD  ALKALINE  SOLUTION  FOLLOWED  BY  ULTRASONIC  'ACETONE  CLEAN 


SAMPLES  A,  B & F 
(WITH  ANODIZE) 
FINAL  SEQUENCE 


1 


SAMPLE  D 

(WITHOUT  ANODIZE  AND  ETCHED) 
FINAL  SEQUENCE 


SAMPLE  E 

(WITHOUT  ANODIZE) 
FINAL  SEQUENCE 


Figure  7-1A.  Schematic  of  Teardown  Inspection,  Initial  Sequence 


FINAL  SEQUENCE 
A,  B & F 
SAMPLES 


FINAL  SEQUENCE 


SAMPLE 


D 


FINAL  SEQUENCE 


SAMPLE  E 


STRIP  ANODIZE  LAYER 


MICROSCOPIC 

EXAMINATION 


OPEN  CRACKS 


ALKALINE  rTCH  AND 
DESMUT 


MICROSCOPIC  EXAM- 
INATION 


EDDY  CURRENT  BOLT  HOLE 
SEARCH;  YIELDED  ONE  SUS- 
SPECT  THAT  WAS  A GOUGE 


OPEN  AT  CATALOGUED 
SUSPECT  LOCATIONS 


NO  PREEXISTENT  CRACKS 


EDDY  CURRENT  BOLT 
HOLE  SEARCH;  SCRIBE 
INDICATION  LOCA- 
TIONS ON  SPECIMENS 


ALKALINE  ETCH  AND 
DESMUT 


MICROSCOPIC 

EXAMINATION 


OPEN  CRACKS 


OPEN  CRACKS 

i 


DEFORM  TO  PLACE  FAY 
SURFACE  IN  TENSION 
(WEB  ONLY  IN  F) 


MICROSCOPIC  EXAMINA- 
TION 


FLUORESCENT  PENE- 
TRANT INSPECT  UNDER 
A BINOCULAR 
MICROSCOPE;  NO 
CRACK  INDICATIONS 


OPEN  SPECIMENS  AT 
THE  SCRIBED  EDDY 
CURRENT  LOCATIONS 


MEASURE  CRACKS 


OPEN  CRACKS 


CONFIRM  IF  CRACKS  WERE 
PREEXISTENT 


MEASURE  CRACKS 


Figure  7— 18.  Schematic  of  Teardcwn  Inspection,  Final  Sequence 
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APPLICATION 

PROCESS  COMPOSITION  TIME  TEMPERATURE 


Paint  Strip 

Turco  52  1 2 Stripper 

* 

2 hts. 

Room 

Alkaline  Clean 

5-6 % Alfrex  in  b^O  (by  volume) 

10  min . 

160-180°F 

Acid  Dip 

25%  H0  SO 

2 4 ^ 

5%  No^Cr^O^  S (by  weight) 

70".:.  H?0  ' 

1 0 min . 

1 45- 1 60°F 

Anodize  Strip 

1 3 .5g  H^PO^l  (waf<,r  f0  make  500  ml) 
IOgC,03  J 

6-  1 5 min  . 

3o  i ! i ng 

Alkal ine  Etch 

3.9%  NaOH  in  V.  , , 

0 l(by  volume) 

4 .0%  NoC  cHoN0  2 J 

5 8 4 ' 

8- 1 6 min . 

1 00- 1 20°F 

(Sodium  Gluconate) 

Desmut 

(Some  as  Acid  Dip) 

10  sec . 

Room 

Total  Metal  Removal  by  all  Processes  Combined  Ranges  from  0.0005"  to  0.0010" 


Figure  7-7.  Cltomical  Treatment  Process  Details 
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Destructive  Inspection 


The  identification  number  of  each  flaw  was  Vibrotool  engraved  on  the  samples  next  to  each 
fastener  hole  where  there  was  an  identified  suspect  flaw.  Orientation  around  these  fastener 
holes  was  maintained  by  a punch  mark  at  the  12  o'clock  position  as  defined  by  drawings  of 
the  samples.  The  samples  were  then  marked  with  lines  for  saw-cutting  into  smaller  laboratory 
specimens.  The  samples  were  photographed  and  subsequently  sow-cut.  Most  of  the  saw-cut 
specimens  were  approximately  I to  2-inch  square  and  contained  one  suspect  flawed  fastener 
hole.  1 lie  remaining  ones  were  larger  with  obvious  flaws,  some  of  which  encompassed  more 
than  one  fastener  hole  . 

The  laboratory  specimens  were  cleaned  in  a mild  alkaline  solution,  including  test  tube  brush 
cleaning  of  hole  walls,  followed  by  submersion  in  on  ultrasonic  cleaner  containing  acetone. 
Initial  inspection  with  a binocular  microscope  using  up  to  30X  magnification  detected  some 
of  the  flaws  which  were  subsequently  opened.  The  remaining  unopened  specimens  were 
further  processed  and  inspected  for  flaws.  Those  specimens  from  Samples  A,  B and  F had 
their  anodize  layer  intact  while  the  anodize  layer  from  Samples  D and  E had  been  previously 
icmoved  prior  to  incorporation  into  this  program.  The  specimens  from  Sample  D exhibited 
considerable  pitting  which  apparently  was  the  result  of  etching  prior  to  incorporation  into 
the  program.  Consequently,  specimens  from  A,  B and  F received  different  laboratory  in- 
spection processing  than  specimens  from  D & E.  The  finol  inspection  step  in  each  specimen 
group  was  to  inspect  for  and  record  hole  wall  conditions  which  moy  be  correlated  to  "false 
call"  indications. 

Specimens  cut  from  A,  B and  F were  stripped  of  their  anodize  coating  and  examined  micro- 
scopically. Those  with  confirmed  flows  were  opened.  Those  which  remained  unopened 
were  alkaline  etched,  desmutted  and  reinspected  with  a binocular  microscope.  Those 
which  now  exhibited  flaws  were  opened.  The  remaining  unopened  specimens  were  slightly 
deformed  by  placing  the  fay  surface  in  tension  in  order  to  partially  open  any  crack.  These 
were  reinspected  under  a binocular  microscope.  Those  which  exhibited  crocks  were  opened 
and  those  which  did  not  were  classified  as  not  being  cracked. 

Eddy  current  bolt  hole  scans  to  pinpoint  crack  positions  on  Sample  D specimens  yielded  only 
one  strong  indication  of  a flaw,  but  when  opened  it  was  a gouge  and  not  a pre-existent 
(fatigue  generated)  crack.  The  remaining  specimens  were  broken  open  at  the  catalogued 
locations  of  the  flaws,  but  no  evidence  of  pre-existent  cracks  was  observed.  The  hole  walls 
were  noticeably  pitted  as  stated  above. 

The  remaining  specimens  cut  from  Sample  E were  examined  using  both  automatic  and  manual 
eddy  current  bolt  hole  scans.  Detected  flaw  locations  were  scribed  on  each  specimen.  Four 
specimens  were  etclied  and  examined  using  a binocular  microscope  and  fluorescent  penetrant 
technique.  No  crack  indications  were  noted.  All  specimens  were  then  opened  at  the  scribed 
flav'  locations.  Generally,  the  condition  of  all  the  hole  walls  was  poor. 

I law  size  measurements  on  the  larger  fatigue  cracks,  those  greater  than  0. 10"  were  made 
under  a binocular  microscope  with  30X  magnification  using  a steel  scale  with  0.01"  length 
divisions.  Flaws  shorter  thon  0.10"  were  measured  with  a graticule  on  a scanning  electron 
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microscope  display.  Precision  on  the  optical  measurements  is  + 0,005"  with  recorded 
values  rounded-off  to  the  nearest  0.01"  . Electron  microscopy  precision  is  + 0.0005" 
with  recorded  values  rounded-off  to  the  nearest  0.001"  . Flow  plane  angularity  with 
respect  to  the  hole  axis  and  the  true  radial  direction  were  also  measured  with  a protractor 
overlay.  Categories  for  recording  flaw  types,  dimensions,  and  angularity  are  shown 
graphically  in  Figure  7-4.  The  destructive  measurements  of  the  catalogued  flaws  for 
structure  samples  "A",  "8",  "E",  and  "F"  are  provided  in  Figures  7-5  through  7-11  . The 
catalogued  flows  for  structure  samples  "C"  and  "G",  whose  crack  lengths  were  determined 
by  visual  measurement  during  fatigue  cycling,  are  provided  in  Figures  7-12  and  7-13. 

A summary  of  confirmed  flaw  size  ranges  by  structure  type,  along  with  total  number  of 
inspection  sites  and  detection  opportunities,  is  presented  in  Figure  7-14. 
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|4 

! 

1 

I 


CRACK  TYPE 


SAMPLE 

CONFIGURATION 


ANGULARITY 


SAMPLE  TYPE 


Crack 

ID  No. 

Crack  1 Cfock  Length  (In.)  | 

Ar?9  , 

Angular  Deviation  (°) 

Type 

Axial  (b) 

Radial  (r)  1 

x 10  4(ln2) 

Axial (q) 

Rodial(JJ) 

A277A 

3 

.09 

.14 

88 

* A3122 

3 

.09 

.09 

43 

A2132 

3 

.09 

.13 

79 

A3 121 

3 

.09 

.16 

106 

A2075 

1 

.08 

.14 

63 

A276B 

3 

.09 

.18 

124 

A2080 

3 

.09 

.16 

106 

A277B 

3 

.09 

.16 

106 

A279D 

O 

v/ 

.09 

.15 

97 

* A2I25 

3 

.09 

.15 

97 

Al  133 

3 

.09 

.16 

106 

A312A 

3 

.09 

.16 

106 

A2078 

3 

.09 

.16 

106 

A209B 

3 

.09 

.19 

133 

* A2131 

3 

.09 

.17 

115 

A 1007 

3 

.09 

.18 

124 

A 108A 

3 

.09 

.17 

115 

* A2130 

3 

.09 

.20 

142 

A310D 

3 

.09 

.25 

187 

Al  101 

3 

.09 

.13 

79 

A276A 

3 

.09 

.20 

142 

A281B 

3 

.09 

.29 

223 

A2123 

3 

.09 

.23 

169 

A108C 

3 

.09 

.26 

196 

A209A 

3 

.09 

.24 

178 

A3UB 

3 

.09 

.25 

187 

A279A 

3 

.09 

.20 

142 

A312B 

3 

.09 

.26 

196 

A108B 

3 

.09 

.28 

214 

A310A 

3 

.09 

.25 

187 

A281  A 

3 

.09 

.28 

214 

A311  A 

3 

.09 

.30 

232 

A310B 

3 

.09 

.30 

232 

A2124 

3 

.09 

.31 

241 

20 

A2020 

3 

.09 

.38 

304 

20 

A104B 

3 

.09 

.45 

367 

* A 106  A 

3 

.09 

.46 

376 

AI04A 

3 

.09 

.52 

430 

* A 105  A 

3 

.09 

.52 

430 

* A106B 

3 

.09 

.60 

502 

* A105B 

3 

.09 

.66 

556 

* A104C 

3 

.09 

1 .05 

952 

Flaw  damaged  during  disassembly  - radial  length  estimated 


Figure  7-5.  Stiucture  Somplo  "A"  Originally  Cataloged  Flaw  Clraracteristics 
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Crock 

ID  No. 

MDSfll 

Crack  Length  (In .) 

Area 

x 10-4  (In2) 

Angular  Deviation  (°) 

Axial  (br 

leueiq* 

EBEHOl 

Radial  (p) 

80338 

3 

.09 

mm 

97 

B0V24 

3 

.09 

K9 

88 

B029B 

3 

.09 

.16 

106 

B042A 

3 

.09 

.16 

106 

li 

B025A 

1 

.06 

.05 

17.5 

B0Q6B 

3 

.09 

.17 

115 

**B001A 

3 

.09 

.12 

70 

**B0023 

3 

.09 

.12 

70 

B036B 

1 

.05 

.07 

21  .0 

B040A 

1 

.07 

.07 

28.0 

B034B 

3 

.09 

.10 

52 

BOUIB 

3 

.09 

.12 

70 

B029B 

3 

.09 

.22 

160 

B006C 

3 

.09 

.20 

142 

**B004A 

3 

.09 

.16 

106 

B009B 

3 

.09 

.22 

160 

BOS  1 B 

3 

.12 

.35 

335 

BOUIA 

3 

.09 

.16 

106 

B035B 

3 

.09 

.17 

115 

**B003  A 

3 

.09 
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Structure  Sample  " B"  Originally  Cataloged  Flow  Characteristics 
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863 

B008A 

3 

mM 
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Figure  7-6.  Structure  Sample  "B"  Originally  Cataloged  Flaw  Characteristics  (cont'd) 


7-15 


■rrnr-grrT^s:ragj^^  *7?-; 
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ID  No. 
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Crack  Length  (In .) 

Area 

x 10‘4  (In2) 
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Axial  (b) 

nmmtnm 

El  047 

4 

.20 

1 .01 

31  .4 

E1049 

1 

.10 

15.7 

30 

5 

E2069 

1 

.20 

.03 

47.1 

E 1 0 1 9 

1 

.07 

.03 

16.5 

8 

0 

E1014 

4 

.22 

.03 

103.7 

17 

0 

El  032 

1 

.20 

.07 

110.0 

8 

8 

E2003 

1 

.25 

.13 

221.9 

16 

0 

Figure  7-7.  Structure  Sample  "E"  Originally  Cataloged  Flow  Characteristics 


7-16 


Crack 

ID  No. 

■ 

Crack  Length  (In.)  j 

Area 

Angular  Deviat 

MBMBBHMai 

k 10‘4  (In2) 

MQ3QIQI 

Rad 

F666W 

5 

.01 

.007 

.55 

F526C 

7 

.01 

.01 

.79 

F568C 

5 

.02 

.03 

4.7 

14 

F581C 

5 

.05 

.06 

23.6 

F582C 

4 

.09 

.02 

28.2 

12 

42 

F670W 

5 

.02 

.02 

3.1 

■ 

F672C 

4 

.11 

.04 

69.1 

10 

FH5C 

5 

.03 

.03 

7.1 

FI71C 

5 

.06 

.07 

3.3 

FI73C 

7 

.01 

.01 

.79 

F615C 

7 

.01 

.06 

4.7 

F665C 

5 

.02 

.04 

6.3 

12 

Fine 

5 

.03 

.09 

21  .2 

10 

3C 

FI  i2W 

5 

.02 

.06 

9.4 

25 

Id 

F226C 

7 

.01 

.01 

.79 

12 

2S 

F282C 

5 

.01 

.03 

2.4 

10 

If 

F676C 

7 

.02 

.07 

11.0 

17 

F109W 

5 

.05 

.05 

19.6 

F124C 

5 

.03 

.04 

9.4 

4 

4C 

F 1 66VV 

3 

.10 

.47 

470.0 

11 

F122W 

5 

.06 

.08 

37.7 

2f 

F671C 

7 

.03 

.01 

2.4 

42 

F179W 

3 

.10 

.79 

790.0 

31 

F220C 

7 

.04 

.07 

22.0 

F218C 

7 

.05 

.08 

31 .4 

12 

F510C 

7 

.02 

.10 

15.7 

F121W 

3 

.10 

1 .43 

1430.0 

41 

F272C 

7 

.02 

.05 

7.9 

10 

4 

F123W 

3 

.10 

.47 

470.0 

2.c 

F224W 

5 

.05 

.09 

35.3 

F169W 

3 

.i0 

.79 

790.0 

F101W 

3 

.10 

.79 

790.0 

F673C 

4 

.15 

.05 

1 17.8 

5 

F684C 

3 

.25 

.30 

750.0 
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Figure  7-8.  Structure  Sample  "F"  Originally  Cataloged  Flaw  Characteristics 
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1 
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mm  in  in  hi 
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1 

.080 
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40.5 
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32.0 

R003B 

! 

.00 

.1! 

49.5 

R004A 

1 
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.11 

61 
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.08 

.13 

58.5 

R017B 
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.08 

.12 

54.0 

R0I8A 

I 

.08 

.11 

49.5 

R018B 

1 

.04 

.02 

5.0 

R019A 

i 

.07 

.09 

36.0 

R019B 

1 

.04 

.03 

7.5 

R020A 

1 

.027 

.027 

5.0 

R020B 

1 

.04 

.05 

12.5 

R02IA 

1 

.07 

.09 

36.0 

R021B 

1 

.06 

.06 
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R022A 

1 

.07 

.10 

40.0 

R023A 
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.04 

.05 

12.5 

R024B 

1 

.08 

.10 

45.0 

R025B 

4 

.007 

.003 

0.3 

R027A 

i 

.06 

00 

o 

• 

28.0 

RC28A 

1 

.08 

.13 

58.5 

R029A 

1 

.08 

.10 

45.0 

R030A 

1 

.020 

.022 

3 .3 

R030B 

1 

.06 

.09 

31 .5 

• 

R031B 

1 

.02 

.02 

3.0 

R032A 

1 

.06 

.09 

31.5 

R033A 

1 

.04 

.05 

12.5 

R034B 

1 

.07 

.08 

32.0 

R035B 

1 

.02 

.03 

4.5 

R037A 

1 

.05 

.06 

18.0 

R037B 

1 

.08 

.12 

54.0 

R038B 

1 

.03 

.03 

6.0 

R040A 

1 

.025 

.029 

5.1 

R041A 

1 

.07 

.09 

36.0 

5 

10 

Figure  7-9.  Structure  Sample  "A"  Confirmed  Suspect  Flow  Characteristics 
Not  Originally  Cotaloged  bjt  Verified  by  Tcardown 
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■SESEISB 
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R042B 

1 

.02 

.02 

3.0 

R044A 

1 

.07 

.12 

48.0 

R045A 

1 

.05 

.07 

21  .0 

R045B 

1 

.04 

.05 

12.5 

R046A 

1 

.03 

.04 

8.0 

R0468 

1 

.01 

01 

0.95 

R047A 

1 

.07 

.10 

11  .5 

RO50A 

1 

.04 

.06 

15.0 

R051A 

1 

.06 

.09 

31 .5 

14 

30 

R053A 

1 

.06 

.07 

24.5 

R055A 

1 

.06 

.07 

24.5 

R056B 

3 

.09 

.15 

97 

35 

R057A 

1 

.02 

.02 

3.0 

R058A 

1 

.01 

.02 

2.0 

R058B 

1 

.05 

.05 

15.0 

R059A 

1 

.03 

.04 

8.0 

R062A 

1 

.03 

.04 

8.0 

R062B 

1 

.02 

.02 

3.0 

R0636 

1 

.03 

.03 

6.0 

R065A 

1 

.008 

.010 

1 .1 

R065B 

1 

.03 

.03 

6.0 

R066A 

1 

.03 

.03 

6.0 

R066B 

1 

.03 

.05 

10.0 

R067A 

1 

.06 

,0b 

26.0 

R067B 

1 

.04 

.05 

12.5 

R068B 

1 

.04 

.06 

15.0 

R069A 

1 

.07 

.09 

36.0 

R070B 

1 

.01 

.01 

1 .0 

R071B 

1 

.05 

.07 

21  .0 

R073A 

1 

.05 

.04 

12.0 

R074A 

1 

.01 

.01 

1 .0 

R075A 

1 

.02 

.02 

3.0 

R076A 

1 

.04 

.06 

15.0 

R076B 

1 

.05 

.07 

21  .0 

R077B 

1 

.04 

.06 

15.0 

R078A 

1 

.08 

.08 

40.4 

R078B 

1 

.05 

.08 

24.0 

R079B 

1 

.04 

.05 

12.5 

R080A 

1 

.002 

.004 

0.56 

R082B 

1 

.05 

.06 

18.0 

35 

R083A 

1 

.04 

.06 

15.0 

17 

R034A 

1 

.04 

.05 

12.5 

Figure  7-9,  Structure  Sample  "A"  Confirmed  Suspect  Flaw  Characteristics 
Not  Originally  Cataloged  but  Verified  by  Teordown  (Cont'd) 
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Crack 

ID.  No. 

Crack 

Type 

Crack  Length  (In.) 

Area 

x 10"4  (In2) 

Angular  Deviation  (°) 

HKBOIOH 

Radial  (p) 

RC87B 

1 

.06 

.07 

24.5 

13 

R088A 

1 

.03 

.02 

4.0 

R089B 

1 

.05 

.04 

12.0 

R090B 

.04 

.04 

10.0 

13 

R091B 

.04 

.05 

12.5 

20 

R092B 

.008 

.006 

0.66 

R093A 

1 

.02 

.03 

4.5 

R095B 

1 

.07 

.08 

32.0 

R097B 

1 

.011 

.006 

0.63 

R099A 

I 

.02 

.02 

3,0 

R099B 

.06 

.06 

21  .0 

R100A 

1 

.05 

.05 

15.0 

°I01  B 

1 

.004 

.004 

0.52 

OB 

1 

.01 

.0! 

0.95 

. j2A 

1 

.035 

.025 

5.6 

R050B 

1 

.010 

.015 

1 

1 .5 

Figure  7-9.  Structure  Sample  "A'  Confirmed  Suspect  Flow  Characteristics 
Not  Originally  Cataloged  but  Verified  by  feordown  (Cant’d) 


W/JHlffiBliKIfB1 


Area 

x ur4 


I A 
2B 
3A 


S004A 

S005A 

S005B 

S006A 

S007A 

S008B 

S0093 

S01QA 

SOU  A 

SOI  IB 

S012B 

S013A 

S019A 

S020B 

S021A 

S023A 

S026A 

S027A 

S028A 

S029A 

S03OB 

S031A 

S032A 

S033A 

S034A 

S034B 

S035A 

S036B 

SOOVA 

SOI  OB 

S023B 


nUuCiUiniii 


Croc 
ID  No. 


Sample  " E" 


T0001 

T0002 


Sample  "F  ’ 


U208W 
U101C 
U1 10W 
U506C 
U603W 
U605W 
U607C 
U61 1W 


Angular  Deviation 


MaminiKSPtwn 


.002 

4.7 

.003 

0.94 

2.17 

217C.0 

0.57 

1425.0 

1 .43 

1430.0 

0.12 

47.1 

8 

0.04 

40.0 

8 

0.14 

140.0 

0.02 

18.8 

15 

1 .42 

142.0 

E"  and  F"  Confirmed  Suspect  Flaw  Characteristics 
aloged  but  Verified  by  Teardown 


fii  % iiiifii  lit  ' ■ • **  **  l'*iwf 


Crack 

ID  No. 

UnSSHl 

X 
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C044A 

3 

■a 

.02 

60 

C0448 

3 

mSm 

.06 

60 

C039A 

7 

0.15 

.06 

28 

C040A 

3 

0.15 

.06 

98 

C015A 

3 

0.15 

.06 

90 

C015B 

3 

0.15 

.06 

90 

C040B 

3 

0.15 

.07 

98 

C043B 

3 

0.15 

.08 

128 

C043A 

3 

0.15 

.09 

128 

C037A 

3 

0.15 

.09 

143 

C037B 

3 

0.15 

.10 

143 

COUB 

3 

0.15 

.10 

158 

COMA 

3 

0.15 

.11 

158 

C051B 

3 

0.15 

.12 

210 

C034A 

3 

0.15 

.14 

210 

C034B 

3 

0.15 

-14 

210 

C054B 

o 

0.15 

.14 

233 

C051A 

3 

0.15 

.16 

210 

C054A 

3 

0.15 

.17 

233 
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0.15 

.17 
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0.15 

.17 
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.18 
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0.15 
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.20 

308 
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0.15 

.21 
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0.15 

.21 

315 
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0.15 

.21 
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C050A 
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0.15 

.21 

323 
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3 

0.15 

.22 

330 
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3 

0.15 

.22 

330 

C029B 

3 

0.15 

.22 

345 

C050B 

3 

0.15 

.22 
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3 

0.15 

.24 

345 
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0.15 
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0.15 
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0.15 
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Figure  7-1?.  Structure  Sample  "C"  Flaw  Characteristics 
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Figure  7-13.  Structure  Sample  "G"  F law  Characteristics 
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Figure  7-13.  Structure  Sample  "G"  Flaw  Characteristics  (Cont'd) 
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Figure  7-13.  Structure  Somple  "G"  Flaw  Characteristics  (Cant'd) 
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SECTION  VIII.  DATA  STORAGE  AND  RETRIEVAL 


The  large  quantity  and  diverse  nature  (numerical  and  narrative  mix)  of  information  acquired 
on  the  NDI  Reliability  effort  has  created  a need  for  on  efficient  data  management  system. 
Additionally,  the  data  management  system  and  processing  functions  are  desired  to  be  com- 
patible with  Wright-Patterson  Air  Force  Base  computer  facilities.  A general  purpose  System 
2000  Data  Management  System,  developed  by  MRI  Systems,  Inc.,  Austin,  Texas,  has  been 
identified  as  fulfilling  the  above  requirements.  Functions  of  the  System  2000  include  storage 
and  organization  of  the  data,  updating  with  new  inputs,  identification  and  isolation  of 
important  data,  preparation  of  reports  in  any  format,  computation  of  averages,  sums  and  other 
fundamental  statistics  and  production  of  decision  making  information.  An  English-like  syntax 
is  used  in  data  handling  which  eliminates  the  need  for  special  programming  skills  to  operate. 

Subroutines,  which  are  transparent  to  the  data  manogement/operator  interface,  can  be  used 
to  calculate  variance  ratios  which  are  used  in  tasting  for  significance  . Subroutines  for  confi- 
dence level  calculations  and  graphic  plots  are  also  transparent  to  the  operator.  Programming, 
data  input  and  initial  processing  has  been  accomplished  through  o Control  Data  Corporation 
terminal  at  Lockheed-Georgia . A transition  to  full  operational  capabilities  with  a complete 
data  repository  at  Wright-Patterson  Air  Force  Base  has  been  provided  as  on  end  product  of  the 
parametric  analysis  effort. 

data  categories 

The  formating  of  the  raw  NDI  Reliability  dr  ta  has  a two-fold  objective:  (a)  arranging  a large 
mass  of  both  numerical  and  narrative  information  for  convenient  storage  and  retrieval,  and 
(b)  data  processing  to  conduct  analyses  and  tests  for  significance  of  variables.  The  first 
objective  is  driven  by  the  need  to  efficiently  obtain  hard  copy  printouts  of  specific  raw  data 
by  selecting  identifier  words  and  to  shunt  selected  data  into  computational  routines.  The 
second  objective  is  to  provide  graphic  information  on  one  variable  plotted  against  a second 
and  to  provide  statistical  calculations  necessary  for  testing  for  significance. 

The  information  acquired  on  the  NDI  Reliability  effort  has  been  divided  into  seven  categories: 
(a)  Flaw  Size  Tabulation,  (b)  Inspection  Results,  (c)  Individual  Inspection  Log,  (d)  Technician 
Profile,  (e)  Base  Daily,  (f)  Facility  Evaluation,  and  (g)  Equipment  Performance.  Each  category 
has  its  contents  listed  in  tabular  punched  card  format  to  be  used  as  initial  computer  data  input. 
The  following  Figures  and  their  associated  notes  show  the  detailed  format  used  for  inclusion  of 
all  the  acquired  raw  data  for  transcription  to  punched  cords  and  computer  programming  opera- 
tions. They  contain  both  encoding  information  and  narrative  descriptions  for  the  complete 
transcribing  process. 

DATA  BASE  DEFINITION 


The  data  management  has  been  accomplished  by  assigning  names  or  descriptions  to  c data  base 
composed  of  elements  in  a hierarchy  of  existing  interrelationships.  A schematic  of  the  data 
base  used  in  this  program  is  presented  in  Figure  8-10.  The  highest  level  descriptor  is  the 
"Sample  Type"  because  it  was  established  os  the  most  fundamental  element  in  the  data 
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acquisition  process;  all  other  descriptions  are  subordinate.  Unique  sets  of  flaw  identifications 
ond  characteristics  are  attached  to  each  Sample  Type  which  has  a large  number  of  subordinate 
results  accompanying  every  flaw.  The  next  lower  level  of  subordination  is  branched  into  two 
categories;  Technician  Profiles  and  the  Facility  Evaluations.  Both  of  these  descriptors  have 
four  subordinate  elements  as  shown  in  the  schematic.  Each  of  the  descriptors  is  assigned  a 
hierarchical  index  value  with  the  smaller  numbers  at  the  tcp  and  Icrger  numbers  signifying  o 
position  of  lower  accession  priority.  A partial  list  of  the  data  base  definition  is  provided  in 
Figure  8-11  in  the  COBOL  language  for  System  2000  input. 

DATA  RETRIEVAL 


Raw  dota  are  directly  assessed  by  o SYSTEM  2000  command  labeled  "LIST"  . This  command 
produces  outputs  in  columnar  format  with  user-specified  column  headings.  The  data  are 
screened  with  standard  "WHERE"  clause  qualifying  descriptors  such  as  List  Results  Where 
Sample  Type  is  "A"  and  NDI  Method  is  "UT"  . Graphic  plots  of  flaw  detection  probabilities 
are  developed  by  "WHERE"  clause  descriptors  alon^  with  a four  card  input  command  entitled 
"NDI  PLOT"  . A number  of  these  graphic  plots  are  presented  in  Section  XI,  "Detailed 
Reliability  Findings"  . 
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COLUMN 


1 

2/3 

4 

5,6 

7,8 

9 

10,  11 

12,  13 

* * * 

* * * 

14 

15 

16 

17 

18 


DATA 


0) 


Dato  Type 
Base  10 

Start  Date:  Year 
Month 
Day 

Completion  Date:  Year 
Month 
Day 


X 

XX 

X 

XX 

XX 

X 

XX 

XX 


Following  Data  obtained  from  Items  1-5  of  Facility 
Evaluation  Sheet,  See  Note  2 


20,21 

22,23 

24,25 

26,27 

28,29 

30,31 


Shop  Type 
Ambient  Conditions 
Lighting  Level 

Noise  Level 

Ancillary  Equipment  Eval. 


19  Work  Area  iize 


r 


i 

i 


5,  6,  7,  or  8 Note  1 
01  - 12 
01  - 31 
5,  6,  7,  or  8 
01  - 12 
01  - 31 


G-General,  H-Hanger,  N-NDI 

C-ControllecirU'Uncontrolled 

P-Poor,  f-Fair,  G-oood, 

E -Excellent 

L-Iow,  M-Medium,  H-High 
T-Poor/T-Fair,  G-Good, 

E -Excellent 

(^Cramped,  M-Moderate, 

L -Large 


Standard  NDI  Jobs  Obtained  from  Standard  Jobs  Sheet 


Ultrasonic 
Eddy  Current 
Penetrant 

X-Ray 
Leak  Check 
Magnetic  Particle 


XX 


Note  3 


Figure  8-1  . Facility  Evaluation  Punched  Card  Format 


8-3 


Figure  8-1 . Focility  Evaluation  Punched  Curd  Format  (continued) 
NOTE  1 


Obtoin  Start  and  Completion  dotes  from  Daily  Log  . Start  date  is  the  date  of  the  first  doy 
at  the  facility  and  the  completion  date  is  the  date  of  the  last  day  at  the  facility. 


NOTE  2 

Assume  the  following  conditions  for  those  data  items  which  are  incomplete. 

Item  14  - G 17  - M 

15 - T  18 -TT 

16 - ter  )9-jx 


NOTE  3 


XX  - Percentage  of  total  NDI  iobs  performed  utilizing  NDI  Method 

If  an  NDI  method  is  not  included  or  if  there  are  no  jobs  listed  after  the  method,  then 
(00)  zeros  will  be  "green  sheeted"  for  the  total  number  of  jobs  performed  for  that  particular 
method . 
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COLUMN 

DATA 

FORMAT 

REMARKS 

1 

Data  Type  (3) 

X 

2,3 

Base  ID 

XX 

4,5 

Instru.  Mfr, 

AA 

Note  la 

6-9 

Model 

XX  XX 

Note  lb 

10-14 

S/N 

XXXXX 

Note  1c 

* * ♦ 

Microvolts  Deflec 

:tion  on  Standard  - Med.  Raiige 

15-17 

0.010" 

XXX 

! Note  2 

18-20 

0.020 

XXX 

21-23 

0.050 

1 

XXX 

1 

. 

NOTE:  1 

a)  (Same  as  Nolo  3a  Individual  Inspection  Log) 

bl  (Same  as  Note  3b  Individual  Inspection  log) 

c)  (Same  as  Note  3c  Individual  Inspection  Log) 

NOIE:  2 

Maximum  deflection  with  initial  setting  of  2.50  is  thcieforo  off  scale  or  pegged 
condition  to  be  coded  n?  999. 


i-i. 


f iguie  8-3  . Equipment  Performance 


• Junent  Punched  C^id  format 


COLUMN 


DATA 


FORMAT 


REMARKS 


\ 


1 

2,3 

4,5 

6-9 

10-14 

15-16 

17-20 

21-25 

26 

27,28 

**• 

29-31 
32,  33 
34,35 
36, 37 
38 

29,40 

41,42 

43,44 

45, 46 


Data  Type  (4) 

X 

Base  ID 

XX 

Instrument  Mfr. 

AA 

Model  No. 

XXXX 

S/N 

XXXXX 

Transducer  Mfr. 

AA 

Model 

XXXX 

S/N 

XXXXX 

Frequency 

X 

Angle 

XX 

Instrument  Set-up 

Coarse  Gain 

XXX 

Fine  Grain 

XX 

Reject 

XX 

Pulse  Length 

XX 

Coarse  Sweep  Range 

X 

Coarse  Sweep  Multiplier 

XX 

F.,.e  Sweep  (Velocity) 

XX 

Horiz-lnter-  Echo  Spacing 

XX 

1-2 

Horiz-Inter-Ecbo  Spacing 

XX 

2-3 


Note  la 
lb 
1c 
la 

1b 

J_lc 
Note  2a 
Note  2b 

Note  3o 

Percent  of  Full  Scale 
Percen*  of  Full  Scole 

Note  3b 

Percent  of  Full  Scale 


47,48  Vert,  Echo-Height  *3 

49,50  Vert,  Echo-Height  *8 


XX 

XX 


| 

1 

! 

1 

t 

1 

i 

I 

t 

i 

i 


! 

i 


* 

r 

j 


i 


Figure  8-4.  Equipment  Performance  - Ultrasonic  Punched  Card  Format 


B-7 


II..I  iliiJlhiUllialliull  IkllJlUllib  ijJLikjJlLiiiJil 


Figure  8-4.  Equipment  Performance  - Ultrasonic  Punched  Card  Format  (continued) 
NOTE:  la,  lb,  lc  (Some  as  Note  3a,  3b,  3c  - Individual  Inspection  Log) 

NOTE:  2 

(a)  0 - Data  not  recorded 

1 - 2.25  MHZ 

2 - 5.0  Mhz 

3 - 10.0  MH. 

(b)  ANGLE  in  degrees  such  as  60°  - 60. 

00  - Dote  not  recorded. 

NOTE:  3 

(°)  Convert  one  and  two  digit  numbers  to  three  digits  as  follows: 

One  digit;  .1  001;  2 020 

Two  digits  0.1  001;  2.0  020 

(b)  Convert  one  digit  numbers  io  two  digits  as  follows: 

.1  01;  2 20 


ti  ii 


.""P'.TiTfflF’T! 


Note  lo 

A-Aqueou*  N-Noo-  Aqueous 
E-Excellent;  G-Good; 
E-Foir;  P-Pooi 


I igi,ie  8-j,  Equipment  Pmfeimonce  - X-Ray  4 Porte  front  Punctad  Cord  f oimot 


Figure  8-5.  Equipment  Performance  - X-Ray  & Penetrant  Punched  Card  Format  (continued) 
NOTE:  la,  lc  & Id  - (Same  as  NOTE  3a,  3c  and  3b,  respectively  - 

Individual  Inspection  Log) 

1b  - Model  Number  - Six  least  significant  digits  of  model  number. 

EX:  691 50 K - 691 50 K;  50  KVA  - 050  KVA 


COLUMN 


1 

2-6 

7 

8,9 
10,  11 
12 

13 

14 

15-17 


DATA 

Data  Type  (6) 
Assigned  A/t  ID  No. 
Date  - V iar 

I Month 
Day 
Level 

High  School  Grad. 

College 

NDI  Training 


FORMAT REMARKS 

X 

XXAXX  Note  1 

X 5,  6,  7 or  8 

XX  01-12 
XX  0 1 - 31 

X Note  2 

X N-No;  Y-Yes  Note  3 
X 0-9  (Number  of  years  completed) 
XXX  Total  Number  of  Hours  Note  4 


18,  19 


24,25 
26,  27 
28,  29 


XX  Note  5 


Job  Experience 
NDI 

Technical 

C lerical/Managerial 

Skilled 

Other 

Skilled/NDI 


Inspections  performed  per  month  on  Engine  (c)  and  Aircraft  Structure 
(A/C)  parts  utilizing  specified  methods. 


30-32  Ultrasonic  (E) 

33-35  " (A/C) 

36-38  Eddy  Current  Surface  (E) 

39-41  (A/C) 

42-44  EC-Bolt  Hole,  Man.  (E) 

45-47  " (A/C) 

48-50  , Auto  (E) 

51-53  w " (A/C) 

54-56  Penetrant  (6) 

57-59  " (A/C) 

60-62  X-ray  (E) 

63-65  " (A/C) 

***  Physical  Data 

66,  67  He Ight 

68-70  Weight 

71.72  Age 

73  Sex 

74  Maritai  Status 

75  Wear  Glasses 

76  Physical  Limitations 


Note  6 


Note  6 


XX  0 - No  Data 

XXX  T 


Note  7 


M-Mole;  f-female 
M-Marr,;  S-Sirglo 
Y-Ycs;  N-No 
Y-Yes;  N- None 


77 


Technician  Evaluation 


Figure  8-6.  Technician  Profile  Punched  Card  Format  (continued) 

NOTE  I 

Assigned  A/T  Identification  No, 

a)  Any  Technician  Profile  Form  which  does  not  contain  a valid  ID  number  will  be 
considered  invalid  and  the  data  will  not  be  "green  sheeted"  . 

Examples  of  valid  ID  numbers: 

1)  Four  digit  numbers:  0916,  0407,  03E8,  03U6 

2)  Five  digit  numbers:  03E12,  16U10,  16U2E 

3)  Six  digit  numbers:  16U10E,  16E11U 

b)  All  ID  numbers  will  be  converted  to  a standard  (5)  five  digit  format. 

Four  digit  numbers  will  be  converted  by  either 

1)  Inserting  the  letter  '8'  between  the  second  and  third  digits  of  those  ID 
numbers  containing  four  numbers  - Ex:  09 1 6-09B 1 6;  0407-04B07 

2)  Inserting  a zero  between  the  third  and  fourth  digits  of  those  ID  numbers 
containing  three  numbers  and  one  letter: 

Fx:  03E8  - 03E08;  03U6  - 03U0<S 

Five  digit  numbers  containing  three  numbers  and  two  letters  will  be  converted 
by  deleting  the  letter  in  the  fifth  digit  and  inserting  a zero  between  the  third 
and  fourth  digits.  Ex:  16U2E  - 16U02 

Six  digit  numbers  will  be  converted  by  deleting  the  letter  in  the  sixth  digit. 

Ex:  16U10E  - 16U10;  16E11U  - 16E11 

NOTE  2 


The  single  digit  skill  level  number  is  derived  from  the  Job  Title  or  AFSC  number.  The 
AFSC  number  is  a five  (5)  digit  number  with  the  fourth  digit  designating  the  skill  level 
(XXX  X X).  Example:  AFSC  ^531  5 5 designates  a level  5 and  AFSC  *536  9 0 a 
level  9.  The  AFSC  skill  levels  are:  3,  5,  7 and  9, 

If  an  AFSC  number  is  not  provided,  a skill  level  coded  reference  will  be  provided  and 
will  be  recognized  as  the  number  or  letter  in  parenthesis. 

NOTE  3 

Any  of  the  following  in  the  GRADUATE  (Space)  signifies  a high  school  graduate: 
yes,  {s/j  check  mark,  year,  GED,  and  No-GED.  A 'no'  or  blank  space  signifies  a 
non-graduate , 

NOTE  4 

Add  tbr  indivUcui  NDI  training  to  obtain  the  foM  number  of  hours.  999  hours  ?s  the 
maximum  hours  which  can  be  "green  sheeted",  therefo.v,  when  the  total  hours  exceed 
999  they  will  be  "green  sheeted"  as  999. 
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Figure  8-6.  Technician  Profile  Punched  Card  Format  (continued) 

NOTE  5 

Job  Experience  is  the  total  number  of  years  a technician  has  worked  in  each  job  category 

A.  Obtain  NDI  experience  from  Item  5 of  the  Technician  Profile  Form. 

Convert  the  months  given  to  the  nearest  year  using  the  following 
guideline:  0-5  Mos.  = 0 Yr.;  6-12  Mos.  = 1 Yr.  and  add  to  the 
years  given  to  obtain  the  total  number  of  years  experience. 

Ex:  9 Yrs.  5 Mths.  - 9 Yrs.;  9 Yrs . 6 Months  = 10  Yrs. 

B.  Item  6 (Job  History)  of  Technician  Profile  Form, 

1)  Categorize  each  job  into  one  of  the  five  categories  1 isted 
below.  Use  the  examples  of  occupations  as  an  oid  in  deter- 
mining the  proper  category. 

2)  Delete  those  jobs  associated  with  NDI. 

3)  Convert  the  From-To  dates  into  the  total  number  of  years 
on  each  job. 

Ex.  From:  Nov  73  To:  Sept  75  = 2 Years 

From:  Nov  73  To:  Jan  75  = 1 Year 

4)  Add  the  total  number  of  years  associated  with  each  category 
and  "green  sheet"  . 


Figure  8-6.  Technician  Profile  Punched  Card  Format  (continued) 
JOB  CATEGORIES 


1 . ND1 

NDI  (Specialist,  Technician,  Superintendent,  Apprentice) 
Skill 

Industrial  Radiographer 
Ultrasonic  Equipment  Operator 
Physical  Science  Technician 

2.  Technical 

Technician 

Engineer 

Chemist 

Laboratory  Worker 

3.  Clerical/Managerial 


Supervisor 

Manager 

Secretory 

Typist 

Operator,  Radio 
Operator,  Teletype 
Operator,  Computer 
Supply  Clerk 

4.  Skilled 

Mechanic 
Machinist 
Brick  Layer 
Carpenter 

5.  Other 

Truck  Driver 
Laborer 
Grocery  Clerk 
Salesman 
Student 

Serviceman  (Army,  Navy,  etc.) 

6.  Ski  I led/NDI 


A/ C Sheet  Mela!  Worker 
Welder 
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Figure  8-6.  Technician  Profile  Punched  Card  Format  (continued) 
NOTE  6 


The  maximum  allowable  number  of  inspections  per  month  for  "green  sheeting"  is  999. 
All  inspections  per  month  greater  than  999  will  be  "green  sheeted"  as  999. 

Ex:  Penetrant  (A/C)1250  — 999 


NOTE  7 


All  heights  will  be  converted  into  inches  before  "green  sheeting"  . 
tx:  5 ft.  1 1 inches  = (5  x <2)  + 1 1 = 60  + 11  =71  inches. 
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COLUMN 

DATA 

FORMAT 

REMARKS 

1 

Data  Type  (7) 

X 

2-6 

Teclmician  ID 

XXAXX 

Note  1 

7-11 

Date  Yr-Mo-Day 

X XX 

XX 

12 

Day  of  Week 

X 

1 -! 

Sun;  2-Mon;  . . .;  7 

-Sat. 

13 

Sample  Type 

A 

'A' 

1 Sample  A;  ...;  'G‘  Sample  G 

14,  15 

NDI  Method 

AA 

Note  2 

16,  17 

Equi 

pment  Mfr. 

AA 

Note  3a 

18-21 

Mode  1 No . 

XXXX 

3b 

22-26 

Serial  No. 

XXXXX 

3c 

27,28 

Probe/Trans . 

AA 

3a 

Film  Mfr. 

29-32 

Model/Type 

XXXX 

1 

f 3b 

33-35 

Inspection  Time 

XXX 

f 

Note  4 

* * * 

Ultrasonic  Method 

36 

Transducer  Frequency 

X 

Note  5a 

37,38 

Transducer  Angle 

XX 

Note  5b 

* * * 

Eddy  Current  Method 

39 

Instrument  Range  Setting 

X 

0 - 

■ Not  recorded;  L - 

Low; 

M 

- Medium;  H-High 

40,41 

Freq  ./liftoff 

XX  i 

W> 

- 99  Note  6 

★ * * 

Penetrant  Technique 

42 

Feneirani  Giouf 

X 

0- 

■ Not  Recorded  (NR) 

43,44 

Dwell  Time 

XX 

Note  7 

Comparison 

45 

Application  Method 

X 

0_ 

- NR;  1 - Spray;  2 

- Brush 

+ + + 

X-ray  Technique 

1 

+ + + 

| lnsf^ection  Area  Density  Range/AIM 

46,47 

Sam 

pie  B-101 

1 XX 

Note  8a 

48,49 

r -io2 

50,51 

-in 

52,53 

-1 12 

54,55 

-121 

56,57 

-122 

58,59 

-133 

60,61 

-134 

67,63 

-301 

64,65 

-302 

66,67 

-141 

68,69 

1 

r -142 

t 

i 

70 

F ilnn 

i Processing 

X 

Note  8b 

Figure  8-7.  Individual  Inspection  Log  Punched  Cord  Format 
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Figure  8-7.  Individual  Inspection  tog  Punched  Card  Format  (continued) 

NOTE  i (Some  os  Note  1 Technician  Profile) 

NOTE  2 

Abbreviate  NDI  Methods  as  follows: 

EA  - Eddy  Current  Bolt  Hole  - Automatic 
EH  - Eddy  Current  Bolt  Hole  - Manual 
EO  - Eddy  Current  - Overhead 
ET  - Eddy  Current  Surface 
PT  - Penetrant 
RT  - X-ray 

UA  - Ultrasonic  - Automatic 
UT  - Ultrasonic 

NOTE  3 

(a)  Equipment  Manufacturer  - First  two  letters  of  Manufacturer's  name. 

Ex:  Branson  - BR;  Sperry  - SP 

(b)  Model  Number  - Four  least  significant  digits  of  a model  number. 

Ex:  ED520  - D520;  ZL-22A  - L22A;  600  - 0600 

(c)  Serial  Number  - Five  least  significant  digit*. 

Ex:  692445  - 92445;  0260  - 00260 

Zeroes  will  be  entered  for  ony  or  all  of  above  where  no  data  is  recorded, 
NOTE  4 


Inspection  Time  - Total  minutes  000-999 
000  - Data  not  recorded 

Determination  of  Inspection  Time 

(a)  determine  the  difference  in  each  Start  Stop  time  (hours  and  minutes) 


Start 

Stop 

1)  11  45 

2)  15  IQ 

* 1470 

1)  0830 

1145 

- 08  30 

-1245 

-1245 

2) 1245 

1510 

3 15 

225 

1)  3 hrs . 15  minutes 

2)  2 hrs . 25  minutes 

* Convert  15  10  to  14  70  by  subtracting  1 hr  (60  min)  from  15  hr  and 
adding  the  60  min  to  10  min  = 14  70. 

(b)  Convert  the  hours  to  minutes  and  add  to  the  existing  minutes: 

1)  3 hrs  15  mins  = (3  x 60)  + 15  = 180  + 15  - 195  minutes 

2)  2 hrs  25  mint  - (2  x 60)  + 25  = 12Q  + 25  - 145  minutes 


MU 


*>♦ 


Figure  8-7.  Individual  Inspection  Loy  Punched  Cord  Format  (continued) 
(c)  Sum  the  individual  inspection  times 

1 ) 1 95  min. 

2)  145  min  = 340  minutes  INSPECTION  TIME 

NOTE  5 

a)  0 - data  not  recorded 
2-2.25  MHz 

5 5.0  MHz 

9 - 10.0  MHz 

b)  ANGLE  in  degrees  such  as  60°  = 60. 

00  - data  not  recorded 

NOTE  6 


00  - no  data  recorded 

Convert  single  digit  numbers  to  two  digit  by  adding  a zero  preceding  the  number. 
Ex:  .9  - 09. 

Conveit  thro**  digit  numbers  to  two  digits  by  deleting  the  third  digit  and  rounding. 

Ex:  2. 25  - 23;  1.13  - 11 . 

NOTE  7 

Dwell  times  - Penetrant  and  Developer 

This  data  item  compares  the  dwell  times  specified  in  the  test  procedure  with 
the  actual  dwell  time  recorded  by  the  technician.  A variation  of  plus  or  minus 
(5)  minutes  or  more  will  be  coded  as  below. 

TEST  PROCEDURE  DWELL  TIME: 

Penetrant  20  minutes;  Developer  20  minutes. 

0 - data  rot  recorded 

1 - required  dwell  time  (RDT) 

2 - under  RDT 

3 - over  RDT 

Ex:  Dwell  time  data:  Penetrant  - 18  min.  Developer  - 1 5 min. 

Coded  - 1 2 

NOTE  8 

a)  1st  digit  - x-ray  film  density  range 
2nd  digit  - x-roy  tube  aim 
(obtain  from  Inspection  Result  Score  Sheet) 

0 - no  data  recorded 
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8-7.  Individual  Inspection  Log  Punched  Card  Format  (continued) 

0 - no  data  recorded 

1 - automatic  processing 

2 - hand  processing 

X-ray  - measured  film  density  range  vs  specified  normal  density  range  and 
estimate  aim  of  x-ray  beam. 

Density  Range: 

0 - both  low  and  high  values  within  range 

1 - both  low  and  high  values  out  of  range 

2 - low  value  in  and  high  value  out  of  range 

3 - high  value  in  and  low  value  out  of  range 

AIM: 

0 - centered 

1 - off  center 
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Figure  8-S.  Inspection  Results  Punched  Cord  Formot  (continued) 


NOTE  1 (Some  os  Note  1 Technician  Profile) 


NOTE  2 Sample  'A'  - A;  Sample  'B1  - B;  Sample  'G1  - _G 

Sample  'G'  contains  123  flawsites,  therefore  a second  inspection  results 

data  card  will  be  required.  The  second  card  will  contain  Flawsite  Results 
and  will  be  a continuation  of  columns  19.  - n . 


Sample  P lowsites 


Sample 


Flawsites 


A 

B 

C 

D 


42 

52 

41 

10 


E 27 

F 43 

G 123 


NOTE  3 (Same  as  Note  2 Individual  Inspection  Log) 


NOTE  4 


Use  Inspection  Results  Score  Sheet 

a)  A check  mark  in  the  Find  or  Miss  column  of  the  score  sheet  is  denoted  by  o 
(0)  Zero  for  a Miss  and  a (I)  One  for  a Find. 

b)  A dash  mark  or  blank  space  in  the  Tind  and  Miss  columns  indicole  a flawsite 
which  was  not  inspected.  This  is  denoted  with  o (2)  two  on  the  "green  sheet 


0 - Miss 

1 - Find 

2 - Flawsite  not  examined. 
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Flaw  size  is  represented  by  two  digits,  therefore  all  three  and  four  digit  numbers  will 
be  converted  to  two  digits. 

Ex:  0.020  = 02;  0.015  = 02 
0.185  - 19;  0.020  = 02 

The  two  flaws  which  are  greater  than  (1)  inch  in  length  will  be  coded  as  follows: 

1 .05  inches  = 95 
1 .95  inches  = 99 


Figure  8-9.  Flaw  Size  Tabulation  Punched  Card  Format 
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DESCRIPTOR 

INDEX 

DATA 

CATEGORY 

1 

Sample-Type 

2 

Flaw-ID 

3 

Flaw- Serial 

4 

Flaw-  Radial -Length 

5 

F law- Bore- Length 

6 

FI  aw- Area 

7 

Flaw-  Angle- Alpha 

8 

F law- Angle-Beta 

9 

Flaw-Type 

10 

Result-Rec 

100 

NDI  -Method 

101 

Base- ID 

106 

Technician-ID 

102 

Rerult-Date 

103 

Result 

104 

False-Find 

105 

Ratio-Find 

1C7 

Command 

20 

Technician-Profile 

203 

Date 

204 

Skill-Level 

Figure  8-11.  Data  Bose  Definition  Sample 
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SECTION  IX.  ANALYSIS  METHODOLOGY 


This  NDl  Reliability  Program  was  planned  to  comprehensively  measure  NDI  perfor- 
mance in  the  setting  where  daily  work  is  normally  conducted  in  field  and  depot 
shops.  As  such,  a number  of  observations  were  necessarily  performed  on  many 
variables  to  document  conditions  surrounding  the  NDI  processes.  Analyses  of  the 
pioyrum  results  may  be  therefore  viewed  in  terms  of  NDI  performance  in  flaw  de- 
tection and  false  calls  relative  to  a variety  of  possible  categories.  A schematic  of 
data  combinations  available  for  analysis  is  depicted  in  Figure  9-1.  Geneial  categories 
of  location,  environment,  participant  capabilities,  equipment  pe>  formance  and  structure 
type,  combined  with  the  NDI  method,  yield  a performance  of  flaw  find/no  find  and 
false  calls.  Each  general  category  of  the  data  has  intrinsic  features  which  allow  for  a 
number  of  subdivisions  which  will  be  discussed  in  a following  section  on  Fundamental 
and  Secondary  Variables.  In  ell  cases,  the  centra!  issue  is  detection  performance  on 
fatigue  cracks  with  given  characteristics. 

Acquisition  Format 


The  genera!  categories  for  data  acquisition  which  were  defined  in  the  planning  phase 
of  the  program  are  as  follows: 

1.  Inspection  results  in  terms  of  flaw  finds,  no  finds,  and  false  calls 

2.  Individual  inspection  logs  containing  date  and  time  of  day,  equipment 
used,  and  NDI  operating  parameters 

3.  Technician  profiles  which  characterized  participant  background 
and  physical  data 

4.  Base  daily  logs  with  weather  and  task  assignment  information 

5.  Facility  evaluations  concerning  the  shop  and  working  conditions 

6.  Equipment  performance  cnecks  which  measured  the  operating 
ranges  of  equipment 

7.  Tabulation  of  flaw  lengths  and  characteristics 

The  last  item,  7,  was  actually  completed  with  estimated  flaw  lengths  in  the  planning 
phase  and  was  used  in  conjunction  with  Item  1,  in  the  initial  performance  evaluations. 
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DATA  COMBINATIONS 


Figure  9-1,  Schematic  of  General  NDI  Data  Categories 
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Qucinf ifafive  result's  are  sought  in  tho  data  reduction  and  evaluation.  A convenient 
format  for  performance  evaluation  is  either  a curve  or  histogram  of  flaw  detection 
probability  relative  to  flaw  size  (flow  length,  a major  factor  in  its  size  considerations, 
is  commonly  used  as  a measure  of  flaw  criticality). 

A second  aspect  of  performance  evaluation  is  a test  for  significance  of  variables. 

This  significance  test  answers  the  question  of  whether  observed  differences  in  flaw 
detection  among  different  combinations  of  variables  are  attributed  to  those  variables 
or  to  chance.  The  analyses  in  this  effort,  therefore,  are  planned  to  not  only  present 
results  with  a number  of  histograms  or  curves  identified  by  a given  set  of  variables,  but 
to  also  quantify  the  significance  of  any  differences  between  those  results  which  are 
selected  by  given  variable  sets. 

Fundamental  ond  Secondary  Variables 

The  fundamental  set  of  variables  that  hove  been  recorded  in  this  program  are  as 
follows: 


a. 

NDI  Method 

f. 

Distinction  Between  Field  or  Depot 

b. 

Structure  Sample  Type 

g. 

Flaw  Identification  Number 

c. 

The  Dare  of  Inspection 

h. 

Flaw  "Find"  or  "No  Find" 

d. 

Participant  Identification  Number 

1 • 

False  Calls  by  Participant 
Identification  Number 

A more  complex  set  of  secondary  variables,  which  interrelate  with  the  fundamental 
set,  heve  also  been  recorded.  They  are  listed  by  type  as  follows: 

A.  Technician  FVofife 

i)  skill  level 

ii)  education  level 

iii)  amount  of  formal  NDI  training 
Iv)  job  history 

v)  NDI  work  pace  (inspection  tasks  per  month) 
vi)  physical  data 

B.  Flaw  Character 

i)  flaw  length 

ii)  flaw  area 

iii)  aspect  ratio 

iv)  orientation  with  respect  to  the  inspection  surface 


9-3 


C.  Impact  ion  Log 

i)  equipment  identification 

ii)  operating  parameters 

iii)  task  assignment  (sample  type  and  NDI  method) 

iv)  day  of  week 

D.  Environment/Facilities 

i)  shop  type 

ii)  ambient  conditions 

iii)  weather 

iv)  work  area  description 

v)  lighting  and  noise  level 

vi)  equipment  performance 

Many  combinations  of  variables  have  been  observed  in  the  course  of  data  acquisi- 
tion; some  are  significant  and  some  are  not.  Subsequent  statistical  treatments  of  the 
recorded  data  will  reveal  which  variables  warrant  attention. 

Graphic  Treatment  of  Variables 

Preliminary  analysis  procedures  which  were  designed  at  the  outset  of  data  acquisi- 
tion phase  yielded  composite  histograms  of  mean  detection  probabilities  for  flaw  size 
ranges  encompassing  an  average  of  seven  individual  flaw  lengths  as  shown  in 
Figure  9-2. 

The  seven  point  grouping  was  arbitrarily  selected  as  the  one  most  convenient  for  view- 
ing the  pattern  of  results  where  grouping  the  data  was  necessary  to  obtain  a sufficient 
sample  size  to  calculate  confidence  bounds  as  described  in  Secti'-'n  3.  As  the  data 
acquisition  progressed,  the  number  of  individual  attempts  to  find  each  flaw  was 
sufficient  to  develop  analytical  approximations  of  detection  probabilities  relative  to 
flaw  lengths  as  shown  in  Figure  9-3.  These  approximations  evolved  by  examining  a 
number  cf  transformations  of  the  variables  to  select  those  which  minimize  scatter  about 
an  estimated  mean,  A reasonably  good  analytical  fit  was  observed  with  the  follow- 
ing transformations: 


x - !/°c  0 ) 

y - [ In  1/p  1 / a^ , where  In  log^  (2) 


where  ac  - the  flaw  size  parameter  and  p = the  point  estimate  of  the  detection 
probability.  For  example,  a fatigue  crock  of  radial  length  ac  = 0.30  inches  has 
been  detected  by  eddy  current  scans  72  tim.es  out  of  90  attempts  to  yield  a point 
estimate  of  the  probability,  p ~0,80. 
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AVERAGE  OF 
7 FLAWS  PER 


ULTRASONIC  SHEAR  WAVE  NDI  PERFORMANCE  ON  STRUCTURE 


Figure  9-3.  Example  of  Curve  Fit  to  Flaw  Detection  Point  Estimates 


The  trend  of  the  transformed  variables  was  then  correlated  to  a generic  expression: 

y - a (x)b  (3) 

where  a and  b are  constants  determined  by  a power  curve  fit  to  the  data  as  follows: 


E (In  x.)  (In  y.)  - (E  Ir.  x. ) (Eln  y.  ) 


E (In  x.  )2-  (E  In  x.  )2 

i i 

N 

E In  y.  E In  x. 

a = exp  f '■  - b 1 (5) 

N N 

N = the  total  number  of  data  points  or  point  estimates  used  to  establish 
the  curve. 


The  coefficient  of  determination  for  the  power  curve  fit  to  the  data  is  given  by: 
E (In  x. ) (In  y.)  - (Eln  x. ) (2 In  y.) 

2 N 


E (In  x.)2  - (E  In  x;  )2  E(ln  y.  )2  - (Eln  y.  )2 
N N 


Combining  equations  (1)  and  (2)  into  (3),  with  the  inverse  transformation,  yields  the 
expression: 


p - exp  [ -a  ( V a ) b 1 ] (7) 

c 

where  p = the  estimated  average  detection  probability. 

Scatter  and  Confidence  Limits 


The  success  or  failure  to  detect  a flaw  by  a number  of  independent  trials,  as  exercised 
in  the  data  acquisition,  should  exhibit  a binominal  character  described  in  the  following 
treatment.  Given  a probability  of  success  = p and  a failure  probability  = 1-p  for  n 
independent  trials,  then  the  probability  of  success  s in  n such  trials  is  expressed  by: 
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(8) 


P (s)  ^|nj  PS  ( 5 “ P ) 

where  s is  f lie  observed  number  of  successful  detections.  This  implies  that  each 
measured  point  estimate  p is  an  average  value  representing  a binomially  distributed 
scatter  of  values.  The  variance  V|  which  quantifies  this  scatter  is  expressed  by: 


Vj  - j £ (1-p)  I /n 


(9) 


where  n r the  total  number  of  attempts  io  detect  the  flaw.  In  actuality,  the  scatter 
which  is  intrinsic  to  each  point  estimate  is  graphically  displayed  in  Figures  9-4  through 
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Detection  performance  on  flaws  within  the  denoted  length  ranges  are  shown  for  a 37 
participant  group.  If  the  flaw  detection  process  is  strictly  mechanistic;  i.e.,  not 
subject  to  human  factors,  the  group  response  would  be  characterized  by  a binomial 
statistic  which  is  illustrated  on  each  performance  histogram.  However,  the  measured 
performance  exhibits  the  influence  of  human  factors  which  has  a bimodal  character; 
an  inhomogeneous  group  of  participants. 

The  second  contribution  to  scatter  lies  in  variability  of  the  flaw  character.  Flaws  of 
nearly  identical  lengths  are  not  dotected  with  the  same  degree  of  success.  The 
variance  V ^ attending  this  source  can  be  directly  evaluated  by: 

V = -L  T.  (p-p)2  (10) 

z N 


where  N = the  total  number  of  point  estimates  and  p — the  analytical  estimate 
of  p.  The  total  variance  is  the  sum  of  the  two  sources  expressed  by: 

v = v.tv,=  [p(l-p)l/n  t - I (p  - p)“  (11) 

i £ N 

Confidence  bounds  attached  to  the  trend  information  can  be  approximated  by  assum- 
ing a normal  distribution  of  contributions  to  the  ' variance  V.  This  assumption  is 
permissible  if  the  following  condition,  described  in  Reference  11,  is  met: 


np-  5 and  n (1-p)  '-5  (12) 

for  the  binomial  component  of  the  variance  Vj.  Additionally,  the  flaws  within  a 
given  size  range  exhibit  an  approximately  normal  probability  distribution  about  the 
estimate  of  the  mean;  which  implies  that  con. . ibufions  to  V2  are  Gaussian. 
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ULTRASONIC  NDI  PERFORMANCE  DISTRIBUTION, 
10  FLAWS  0.09"  - 0.13" 


Figure  9-4.  Performance  Distribution  on  a Difficult  Flaw  Detection  Task 


ULTRASONIC  ND!  PERFORMANCE  DISTRIBUTION,  10  RAWS 
0.25"  - 0.57"  6.4mm  - 14.5mm 


0.5 


binomial  distribution 

MF AN  PROBABILITY  0.70  / 


FRACTION  OF 
GROUP  (N  37) 


0.2 


SUCCFSSES  in  to  ATTEMPTS 


F iguro 


9-6.  Perfoi  money  Disti  ibul  ion  on  on  Easy  Mow  DoU'ction  Task 


V-ll 


ULTRASONIC  NDI  PERFORMANCE  DISTRIBUTION,  5 FLAWS 
0.39"  - 0.57"  9.9mm  - 14.5mm 


Figure  9-7.  Performance  Distribution  on  a Very  Easy  Flaw  Detection  Task 
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Although  it  has  been  pointed  out  that  Vj  is  not  truly  binomial,  the  combined  in- 
fluencei  of  Vj  and  Vj  can  be  reasonably  treated  by  Gaussian  multipliers  t 
to  determine  confidence  bounds  as  follows: 


p - exp 
ro 


!-o,l/a  )b-' 

c 


t I 


O' 


(»-p) 


/ n 


N 


T ( P-P)2 


1/2 


(13) 


where  t values  are  assigned  for  selected  levels  of  confidence  shown  in  Figure  9-8 
(Reference  13). 


Level  of  Confidence 

t 

0 

0.50 

0 

0.90 

1 .29 

0.95 

1 .65 

0.99 

2.33 

Figure  9-8.  Gaussian  Multipliers  for  Selected  Levels  of 
Confidence 

Tests  for  Significance 

A product  of  the  preliminary  analyses  was  the  test  for  significance  of  selected 
variables.  The  variables  of  flaw  size  in  four  length  groups,  NDI  method,  participant 
and  test  site  or  location  were  examined  for  significance  conducted  early  in  the  data 
acquisition  phase  are  provided  in  Figure  9-9.  The  significance  of  flaw  size  (estimated 
length)  was  shown  to  be  very  great,  as  would  be  expected.  The  NDI  method  was  also 
evidenced  as  a significant  variable  in  the  total  scheme  of  flow  detection.  Variance 
attributed  to  differences  among  participants  (technician  variable)  at  the  field  level 
were  insignificant.  However,  the  differences  among  participants  at  depots  was 
significant . 

These  tests  for  significance  were  performed  on  variance  rotios  calculated  from  the 
division  of  variances  by  the  residuals*  for  a g iven  set  of  four  variables.  A schematic 
of  the  calculation  sequence  is  depicted  in  Figure  9-10.  The  data  acquisition  and 
method  of  analysis  in  testing  for  significance  were  patterned  after  a factorial**  ox- 


* The  residuals  are  the  differences  of  the  actual  observations  and  a regression 
quantity  based  on  the  associated  second  vai  iable  in  a covoriance  analysis. 

**A  design  where  all  factors  ore  varied  simultaneously,  as  contrasted  to  a design 
which  allows  only  one  factor  to  vary  while  the  remaining  ones  are  held  constant. 
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SIGNIFICANCE  OF  PARAMETERS 


Figure  9-9.  Tests  for  Significance  of  Variables  Conducted  Early  in  the  Program  from  1 Depot  ond  3 Field  Installations 
The  "F"  Ratio  is  that  Value  which  Reflects  Variance  due  to  Randomness 


TESTS  FOR  SIGNIFICANCE 


Figure  9-10.  Calculation  Sequence  for  Statistical  Tests  for  Significance 


perimental  design.  The  matrix  depicted  in  Figure  3-1  shows  brs.dc  combinations  of 
stri'cture  type  and  ND1  methods.  This  matrix  can  be  extended  to  encompass  ony 
number  of  variables  in  theory,  but  was  limited  to  four  in  this  analysis.  The  tests  for 
significance  treated  the  four  variables  of  flaw  size,  NDI  method,  technician  and  site. 
Other  combinations  could  be  day  of  week,  time  of  day,  technician  age  and  skill  level, 
for  example.  Some  given  sets  of  variables  such  as  those  paired  in  Figure  3-1,  will 
have  missing  combinations.  This  particular  sei  of  variables  exhibits  blanks  in  the 
matrix  (non -orthogonal  data)  because  not  all  structure  types  are  Inspected  by  all  NDI 
methods.  An  incomplete  matrix  situation  can  be  handled  by  a scheme  for  treatment  of 
non-orthogonal  data.  Goulden  '^)  has  devoted  a chapter  to  this  in  his  text  on  "Methods 
of  Statistical  Analysis." 

The  missing  value  treatment  is  based  on  substituting  dummy  values  into  a covariance 
analysis  scheme  with  master  variables  S and  X.  The  S master  variable  represents  original 
values  for  the  flaw  defection  data  acquired  and  the  X master  variable  represents  missing 
data.  Where  values  in  S exist,  the  assigned  value  of  X = 0,  and  where  no  values  of  i, 
exist,  the  assigned  value  of  X = -1  is  used.  The  original  analysis  scheme  contained 
eight  variables  defined  in  Figure  9-11. 


Cede  Symbol  Variable 

Q Test  Site 

P Technician  Skill 

N Sample  Type 

M Inspection  Type 

l Test  Site 

K Technician 

J NDI  Method 

I Flaw  Size  Class 


Range 

Depot  or  Field 
Level  Three  Levels 

Six  Structure  Types 
Overhead  or  Below 
Twenty-Two  Locations 
Participants  Per  Site 
Seven 
Four 


Figure  9-11.  Variables  Included  in  Original  Analysis  Scheme  to  # 
Test  for  Significance 

Symbolically,  file  variables  are  expressed  as: 

S(QPNMLKJI)  and  0*) 

X(GPNMLKJI)  (15) 

composing  an  eight  dimensional  matrix  array  in  each  case. 
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As  previously  noted  data  processing  has  been  limited  to  simultaneous  treatment  of  four 
of  the  eight  variables  because  of  matrix  complexity.  Calculations  for  the  covariance 
analysis  follow  the  standard  format  of  algebraic  solutions  to  obtain  variance  ratios, 
except  that  each  master  variable  is  an  array  of  individual  variables.  Data  pooling  is 
performed  on  the  arrays  in  selected  combinations  to  operate  on  only  those  variables  of 
concern  in  the  immediate  analysis.  An  example  of  pooling  to  treat  three  variables  is 
symbolically  presented  in  the  following  expression: 

Q 

SQ(PNM)  = rma*  $(QPNM)  (1 

1 


where  Qm  = the  value  of  Q far  which  real  values  of  S(QPNM)  exist.  Similarly, 
the  secondhand  third  level  reductions  are  accomplished  by  using  the  following  ex- 
press i ons : 


Q P 
max  max 


SQP(NM)  = j: 


(QPNM) 


(17) 


Q P N 

max  max  max 

SQ?N(M)  = T.  v T (QPNM) 

1 1 1 


(18) 


The  complementary  arrays  in  X are  treated  in  the  same  manner.  The  calculations  of 
variance  ratios  are  performed  by  the  expressions: 


2 2 ^ S 

Sums  of  squares  in  primary  arrays  >'  s -$  - ( 7-—  ) 


(19) 


2 2 2 

Sums  of  squares  in  complementary  arrays  V x - >’  X - ( >'  X ) (20) 


N 


Sums  of  uiiuy  products  v sx  SX  - 


?:s  XX 

N 


(?l) 


2 2 2 2 

Resultant  sums  of  squares  Y z = Y x - 2b  >'  sx  + b Y i (22) 


where : 


b 77 


(73) 


which  is  the  regression  coefficient. 
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Residuals  are  determined  from  total  sums-of-squares  minus  the  contributions  to  sums -of - 
squares  from  each  variable  and  combination  of  variables.  Variances  are  calculated  by 
dividing  the  resultant  sums-of-squares  by  their  associated  degrees  o freedom  and  tiro 
variance  ratios  are  determined  by  dividing  these  by  the  residual  variance.  Comparisons 
of  the  variance  ratios  to  "F"  ratios,  which  represent  variability  attributed  to  chance, 
yield  tests  for  significance. 

Comprehensive  Analysis 

The  comprehensive  analysis  of  data  acquired  in  this  effort  is  a computerized  performance 
evaluation  shown  schematically  in  Figure  9-12.  A data  management  system  for  filing 
and  retr  ieving  information  is  employed  with  processirg  subroutines  for  curve  plots, 
histograms  and  tests  for  significance . Analyses  are  aimed  at  examining  the  most  apparent 
relationships  which  consist  of  five  following: 


I.  Graphic  Plots  - Flow  length  versus  probability  of  detection 
1-1  By  NDI  Method  and  Structure  Type,  All  Technicians 
1-1.1  Upper  50%,  25%,  10%  and  5%  performers 
1-1.2  By  technical  job  experience  (5  categories) 
1-1.3  3y  field  and  depot  categories 
1-1.4  By  each  day  of  the  week 

1-1.5  By  technician  skill  level 

1-1.6  By  technician  education  level 

1-1.7  By  technician  age 

1-1.8  By  technician  NDI  years  of  experience 

1-1.9  By  tec!  mi  cion  NDI  training  hours 

1-1.10  By  weather  conditions 

1-1.11  By  base 

1-1.1?  By  commands 


9-18 


PERFORMANCE  EVALUATION 


t- 

i 

t 

r 

L 


9-19 


II.  Tests  for  Significance  - Base  composite  performance 

1 1— 1 . By  NDI  Method,  all  structure  types 

11-1.1  By  ND!  method,  by  structure  type 

11-1.2  By  NDI  method,  by  structure  type,  by  equipment  performance 

11-2.  By  shop  type 
I ! — 3 . By  work  area  conditions 
11-4.  By  light  level 
11-5.  By  noise  level 
11-6.  By  standard  jobs 
11-7.  By  weather  conditions 

II- 8.  By  equipment  parameters 

III.  Probability  of  Derection  versus: 

III- l.l  Flaw  identification  number  (ranking) 

111-1.1  Flaw  identification  number  by  NDI  method 

111-1.2  Flaw  identification  number  by  flaw  area 

111-1.2,1  Flaw  identification  number,  by  flaw 
area,  by  NDI  method  and  sample  type 

111-1.3  Flaw  identification  number  by  flaw  aspect  ratio 

II 1-1 .3. 1 Flaw  identification  nuntbei  by  flaw 
aspect  ratio,  by  NDI  method  and 
sample  type 

111-1,4  Flaw  identification  number  by  flaw  surface  posi- 
tion 

lll-l  .4. 1 Flaw  identification  number  by  flaw 
surface  position,  by  NDI  method  and 
sample  type 
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III-!  .5  Flew  identification  number  by  flaw  plane  angle 
to  surface 

111-1  .5,1  Flaw  identification  number  by  flow 
plane  angle  to  surface,  by  NDI 
method  and  sample  type 

IV.  Individual  Perfoimance  Distributions 

IV- 1 . By  NDI  method,  by  structure  type,  by  flaw  length 


Combinations  within  parameter  Group  I provide  an  examination  of  effects  due  to 
technician  background  and  base  location  influences.  The  comparisons  within 
parameters  Group  II  relate  performance  to  environment  and  equipment,  those  in 
parameter  Group  III  examine  peculiarities  of  the  flaws  themselves,  and  those  in 
parameter  Group  IV  reveal  the  impact  of  human  factors.  Detailed  analyses  and 
graphic  presentations  of  results  are  provided  in  Sections  X and  XI  . 
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SECTION  X.  OVERALL  NDI  RELIABILITY  FINDINGS 


This  section  presents  overall  flaw  detection  capabilities  observed  in  this  program.  The 
data  are  inclusive  for  all  participants  and  it  is  cautioned  that  generalizations  not  be 
made  from  these  overall  Air  Force  results.  Translation  to  specific  sets  of  conditions  will 
require  judgment  based  on  extensive  NDI  experience.  Detailed  analyses  with  regard  to 
selected  variables,  in  addition  to  NDI  method  and  structure  sample  type,  are  provided 
in  Section  XI . 

Probabilities  of  fatigue  crack  detection  relative  to  flaw  length  in  the  structure  samples 
examined  by  NDI  in  this  program  are  graphically  plotted  in  Figures  10-1  through  10-13. 
These  plots  display  aggregate  detection  probabilities  established  by  a large  number  of 
independent  attempts  to  find  the  flaws.  Each  attempt  was  conducted  by  an  individual 
who  was  selected  by  Air  Force  management  to  participate  in  this  effort.  A total  spectrum 
of  proficiencies  among  participants  was  requested  at  the  outset  of  the  data  acquisition 
and  the  results  bear  this  out.  The  plots  represent  measurement  under  documented  sets  of 
conditions  by  given  NDI  methods  on  specific  structural  configurations. 

The  curves  are  regression  fit  to  the  point  estimates,  as  described  in  Section  IX.  Each 
curve  is  accompanied  by  the  regression  coefficients  (a,  b)  and  coefficient  of  determination 
(r),  which  indicates  the  "goodness"  of  fit  (1  .0  maximum).  Lower  95%  confidence  bounds 
are  provided  to  depict  the  combined  effect  of  data  scatter  and  sample  size  on  the  uncer- 
tainty in  the  measurements. 

Characteristics  of  Results 


The  curves  which  estimate  detection  probability  relative  to  flaw  length  are  distinguished 
by  their  slopes  and  maxima  within  the  depicted  flaw  length  ranges.  The  ideal  curve  snape, 
in  a limiting  case,  would  be  a step  function  which  transitions  from  0 to  1 .0  detection 
probability  over  an  infinitely  small  flaw  length  range.  Si ch  a transition  would  mean  that 
no  "gray  area"  exists;  ail  flaws  above  a threshold  length  are  detected.  On  the  other  hand, 
a gradual  transition  from  low-to-hign  detection  probabilities  over  a wide  flaw  length  range 
would  be  far  from  ideal  because  judgment  must  be  exercised  concerning  the  large  "gray 
area"  . This  effort  has  produced  data  which  exhibit  curve  shapes  which  range  broadly 
within  the  spectrum  from  step  function  to  gradual  transition  characteristics. 

Eddy  Current  Surface  Scans,  Sample  A,  Figure  10-1 


This  curve  depicts  flaw  detection  characteristics  for  eddy  current  surface  scans  around 
countersunk  fastener  heads  in  the  cover  (skin)  of  an  intact  wing  box  section.  The  NDI  task 
is  performed  with  access  to  the  inspection  area  approached  from  the  upper  surface.  The 
mean  results  show  a reasonably  steep  slope  In  the  0.10"  to  0.30"  radial  length  range  and  a 
continuing  rise  in  the  trend  at  the  maximum. 

Ultrasonic  Shear  Wove  Scans,  Sample  A,  Figure  10-2 

This  sample  is  similar  to  the  above  eddy  current  scans  except  that  the  operation  involves 
ultrasonic  shear  wave  transducer  scans  instead  of  eddy  current  surface  scans.  The  trend  of 
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the  mean  has  a more  gradual  rise  compared  with  eddy  current  scon  results.  A continued 
rise  is  exhibited  at  the  maximum. 

Semiautomatic  Ultrasonic  Shear  Wave  Scans,  Sample  A,  Figure  10-3 

The  semiautomatic  shear  wave  inspection  was  performed  with  a transducer  positioning 
device.  The  results  show  a marked  improvement  over  hand-held  transducer  scans.  Except 
for  i;.e  existence  of  four  outlier  points,  the  trend  of  the  mean  closely  approximates  a step 
function  to  1 .0  probability  in  the  radial  flaw  length  range  from  0.10"  to  0.30"  . 

Eddy  Current  Surface  Scans,  Sample  B,  Figure  10-4 

Performance  of  this  task  was  identical  to  the  eddy  current  scans  on  Sample  A except  it 
was  o bench-top  activity.  The  trend  of  the  mean  for  this  sample  rises  more  dramatically 
from  higher  probability  values  in  the  smaller  flaw  length  region,  as  contrasted  to  eddy 
current  results  on  Sample  A.  The  curve  also  exhibits  an  asymptotic  character  as  it  reaches 
the  upper  end  of  the  flaw  length  range.  This  is  a feature  of  the  regression  fit  which  is 
common  to  all  the  curves  but  is  not  as  pronounced  where  initial  slopes  are  low. 

Overhead  Eddy  Current  Surface  Scans,  Sample  B,  Figure  10-5 

The  trends  for  this  case  are  not  decidedly  different  from  those  depicted  in  Figure  10-4. 
Since  there  was  no  apparent  influence  due  to  overhead  scans  contrasted  to  bench-type 
eddy  current  NDI,  this  task  was  discontinued  after  the  sixth  base  visit. 

Radiographic  NDI,  Sample  B,  Figure  10-6 


This  plot  shows  a great  amount  of  scatter  because  the  radiographic  method  is  more  sensi- 
tive to  crack  opening  than  to  crack  length.  The  task  involved  precise  aiming  of  x-rays 
to  obtain  good  quality  of  exposures,  using  the  equipment  trailer  as  a simulated  fuselage 
structure.  The  results  show  a gradual  rise  in  mean  detection  probabilities  with  increasing 
crack  length  similar  to  that  shown  in  Figure  10-2.  The  95%  lower  confidence  bound, 
however,  is  somewhat  less  because  ot  the  scatter. 

Penetrant  NPi,  Sample  C,  Figure  10-7 


The  task  of  penetrant  NDI  on  this  sample  required  participants  to  view  indications  both 
overhead  and  below,  within  the  interior  oF  Structure  Sample  A.  The  results  are  similar 
in  curve  shape  to  those  depicted  in  Figure  10-4. 

Ultrasonic  Shear  Wave  Scans,  Sample  C,  Figure  10-8 

Ultrasonic  scans  in  this  task  were  performed  both  overhead  and  below,  within  Sample  A. 
The  plot  exhibits  little  trend  information,  and  wide  scatter.  The  detection  probabilities 
are  comparatively  high  for  small  cracks  but  there  is  no  real  improvement  with  increasing 
flaw  lengths . 


Eddy  Current  Bolt-Hole  Scans,  Sample  £,  Figure  10-9 

This  task  was  performed  by  incrementing  an  eddy  current  probe  through  bolt  holes.  The 
results  show  a curve  shaped  like  the  one  in  Figure  10-4.  The  flaw  length  in  this  case  is 
axial;  not  radial  as  presented  in  the  previous  examples.  The  mean  probability  point 
estimates  are  generally  low  and  observed  flaw  lengths  are  confined  to  range  below  0.25"  . 
Tire  remainder  of  the  curves  are  extrapolations. 

Automatic  Eddy  Current  Bolt-Hole  Scans,  Sample  E,  Figure  10-10 

This  inspection  used  automatic  equipment  with  strip  chart  recordings,  as  compared  with 
the  above  manual  scans.  Trend  information  is  practically  nonexistent  with  only  a 0.5 
probability  increment,  for  example,  over  the  measured  crack  length  range  of  0.05"  to 
0.25"  . The  capability  is,  however,  markedly  improved  over  that  shown  In  Figure  10-9. 

Eddy  Current  Bolt-Hole  Scans,  Sample  F,  Figure  10-11 

The  performance  of  manual  bolt-hole  scans  in  this  task  involved  probing  multilayer  con- 
figurations. This  added  element  of  complexity  influenced  flaw  detection  in  the  0.15"  to 
0.25"  axial  crack  length  range  if  comparisons  are  made  with  Figure  10-9. 

Automatic  Eddy  Current  Bolt-Hole  Scans,  Sample  F,  Figure  10-12 

This  task  was  performed  as  the  one  described  for  Figure  10-10.  The  automatic  equipment 
with  the  recording  capability  provided  the  instrument  readouts.  As  in  the  case  with 
Sample  E,  a marked  improvement  over  manual  operation  can  be  observed. 

Ultrasonic  Shear  Wave  Scans,  Sample  F,  Figure  10-13 

Ultrasonic  NDI  on  this  sample  was  performed  from  both  outside  and  inside  the  structure. 
The  results  are  plotted  with  reference  to  radial  crack  lengths;  in  contrast  to  the  above 
eddy  current  bolt-hole  examples.  The  low  probability  values  across  the  entire  flaw  length 
range  precluded  the  determination  of  the  lower  95%  confidence  bound.  The  curve  lacks 
any  pronounced  slope  change  compared  with  the  previous  tesk  results  on  this  sample. 

Outstanding  Depot,  Eddy  Current  Bolt-Hole  Scans,  Sample  E,  Figure  10-14 

The  superior  performance  with  eddy  current  bolt-hole  NDI  at  the  second  depot  installa- 
tion is  presented  for  the  forged  wing  fittings.  There  are  seven  flows  in  this  sample  but 
only  five  point  estimates  show  because  there  are  identical  probability  values  of  1 .0  for 
three  0.20"  flaws.  The  95%  confidence  bound  was  not  computed  because  there  was  not 
n sufficient  number  of  participatino  technicians  to  provide  a valid  confidence. 


Outstanding  Depot,  Eddy  Current  Bolt-Hole  Scons,  Sample  F,  Figure  10-15 

This  plot,  which  also  presents  a superior  eddy  current  bolt-held  NDI  pe'bnnnce,  shows 
a trend  in  mean  values  which  is  similar  to  Figure  10-14.  This  effort,  os  above,  also  had 
a low  level  of  participation,  precluding  a 95%  confidence  bound  computation. 
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Figure  10-1  . Probability  of  Detection  Versus  Fatigue  Crack  Radial  Length,  Eddy 
Current  Surfaco  Scans  Around  Countersunk  Fasteners,  Skin  and 
Stringer  Wing  Assembly,  Sample  A. 


DETECTION  PROBABILITY 
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Figure  10-2.  Probability  of  Detection  Versus  Fatigue  Crack  Radial  Length,  Ultrasonic 
Shear  Wave  Scans  Around  Countersunk  Fasteners,  Skin  and  Stringer  Wing 
Assembly,  Sample  A, 
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Figure  10-3.  Probability  of  Detection  Versus  Fatigue  Crack  Radial  Length,  Semi- 
Automatic  Ultrasoni  - Shear  Wave  Scans  Around  Countersunk  Fastene 
Skin  and  Stringer  Wing  Assembly,  Sampie  A. 
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Fi.jure  10-4.  Probability  of  Detection  Versus  Fatigue  Crack  Radial  Length,  Eddy 
Current  Surface  Scar.s  Around  Countersunk  Fasteners,  Skin  and 
Stringer  Wing  Segments,  Sample  B. 
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Figure  10-5.  Probability  of  Detection  Versus  Fatigue  Crack  Radial  Length,  Overhead 
Eddy  Current  Surface  Scans  Around  Countersunk  Fasteners,  Skin  and 
Stringer  Wing  Segments,  Sample  B. 
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Figure  10-6.  Probability  of  Detection  Versus  Fatigue  Crack  Radial  Length,  Radiograph! 

NDI  for  Cracks  Around  Countersunk  Fasteners,  Skin  and  Stringer  Wing 
Segments,  Sample  B. 
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Figure  10-7.  Probability  of  Detection  Versus  Fatigue  Crack  Radial  lengi:i,  Penetrant 
NDI  for  Edge  Cracks  in  Simulated  Wing  Risers,  Sample  C. 
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INSPECTIONS  PER  DATA  POINT;  104 
REGRESSION  COEFFICIENT^:  a =0.147,  b = M5 

COEFFICIENT  OF  DETERMINATION:  r2  * 0.73 


FLAW  AXIAL  LENGTH  ac  (IN.) 


Figure  10-9.  Probability  of  Detection  Versus  Fatigue  Crock  Axial  Length,  Eddy 

Current  Bolt-Hole  Rotational  Scans,  Forged  Wing  Fittings,  Sample  E. 
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Figure  10  10.  Probability  of  Detection  Versus  Fatigue  Crack  Axial  Length, 
Automatic  Eddy  Current  BoH-Hole  Rotational  Scans,  Forged 
Wing  Fittings,  Sample*  E. 
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Figure  10-11  . Probability  of  Detection  Versus  Fatigue  Crack  Axial  Length,  Eddy 
Current  Bolt-Hole  Rotational  Scans,  Wing  Spar  Assembly,  Sample  F 
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10-12.  Probability  of  Detection  Versus  Fatigue  Csack  Axial  length, 
Automatic  Eddy  Current  Bolt-Hole  Rotational  Scans,  Wing  Sp 
Assembly.  Sample  F. 


Figure  10-13.  Probability  of  Detection  Versus  Fatigue  Crock  Radial  Length,  Ultrasonic 
Shear  Wave  Scans  Around  Open  Fastener  Holes,  Wing  Spar  Assembly, 
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Figure  10-14.  Probability  of  Detection  Versus  Fatigue  Crock  Axial  Length, 

Eddy  Current  Bolt-Hole  Rotational  Scans,  Forged  Wing  Fittings, 
Sample  E - Outstanding  Depot  Performance 
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Figure  10-15.  Probability  of  Detection  Versus  Fatigue  Crack  Axial  Length, 
Eddy  Current  Bolt-Hole  Rotational  Scans,  Wing  Spar  Assembly, 
Sample  F - Outstanding  Depot  Performance 


I 


SECTION  XI.  DETAILED  RELIABILITY  FINDINGS 


The  detailed  findings  in  this  program  have  concentrated  on  analysis  of  human  factors  effects 
inherent  to  flaw  detection  probabilities.  Observations  of  raw  data  trends  which  were 
attributed  to  individual  differences  within  relatively  constant  environmental  conditions, 
showed  potential  for  uncoverin^  significant  human  factors  sources  of  variability.  A knowlege 
of  these  sources  of  variability  and  their  relative  contributions  to  flow  detection  probabilities 
allows  for  defining  courses  of  action  for  improving  NDI  performance. 

The  da^a  management  system  described  in  Section  VIII,  Data  Storoge  and  Retrieval,  has  been 
employed  to  select  and  process  raw  data  to  provide  a number  of  detection  probability  curves 
which  exhibit  the  effects  of  identified  parameters.  These  parameters  are  listed  under  the 
heading.  Graphic  Plots,  as  part  of  the  comprehensive  analysis  described  in  Section  IX, 
Analysis  Methodology.  A totol  of  thirteen  basic  anolyses,  excluding  the  day  of  week  classi- 
fications, have  been  selected  from  the  comprehensive  analysis  list  for  computer  plots.  Each 
of  the  basic  analyses  contained  in  this  Section  has  been  developed  f o.  data  combinations  of 
structure  type  and  NDI  method  within  the  following  categories  of  variables: 

1 . All  participants  (also  presented  as  curves  in  Section  X). 

2.  Upper  50%  performers. 

3.  All  depot  participants. 

4.  Skill  level  3;  new  entrant,  into  NDI. 

5.  Skill  level  5;  the  majority  of  practicing  technicians. 

6.  Skill  level  7;  advanced  technicians. 

7.  Those  not  graduates  of  high  school. 

8.  Those  under  twenty-five  years  of  age. 

9.  Those  over  forty  years  of  age. 


10.  Participants  with  three  years  or  less  experience. 

1 1 . Participants  with  over  ten  years  experience  . 

12.  Participants  with  up  to  two  hundred  NDI  treining  hours. 

13.  Participants  with  over  five  hundred  NDI  training  hours. 

In  some  cases,  the  qualifications  placed  on  raw  data  selection  for  generating  a plot  hove  re- 
sulted in  an  insufficient  quantity  for  the  curve  fitting  routine.  For  example,  the  raw  data 
available  to  plot  eddy  current  surface  scan  detection  probabilities  on  structure  sample  A,  for 
level  3 personnel  was  insufficient  for  the  plotting  routine  ond  does  not  appear  in  the  series 
of  detailed  findings.  Each  of  the  plots  has  identical  axes  with  the  overall  detection  probabili- 
ties (all  technicians)  plots  at  t fie  beginning  of  each  series  of  sample  type/NDI  method  onolyses. 


H 
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Curve  fitting  and  confidence  bound  calculations  were  performed  using  the  mathematics  pre- 
sented in  Section  IX . 
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The  computer  line  printer  plots  in  Figures  11-2  through  11-96  display  asterisks  (*)  for  detec- 
tion probability  estimates,  periods  (.)  for  calculated  data  trend  approximations,  and  positive 
signs  (+)  for  extrapolations.  A description  of  the  legend  and  plotting  format  is  provided  in 
Figure  11-1.  The  plotting  rojtine  operates  on  fifty  increments  across  the  X-axis  and  seventy 
increments  up  the  Y-oxis.  In  the  event  that  more  than  one  probability  value  exists  within  a 
1/50  by  1/70  urea,  the  plotting  routine  combines  then  to  print  a single  point  estimate. 
Therefore,  the  number  of  flows  listed  for  each  plot  may  be  larger  than  the  number  of  asterisks 
(*)  printed. 

Two  additional  findings  are  graphically  presented,  following  the  computer  plots.  These  are 
manually  plotted  treatments  of  the  effects  of  environmental  temperature  on  performing  radio- 
graphic  NDI  and  the  effects  attributed  to  differences  in  the  ultrasonic  equipment  used. 

Figure  11-97  shows  two  mean  detection  probability  curves  for  radiographic  NDI;  one  repre- 
senting combined  results  under  winter  temperature  conditions  at  Dover  AFB,  Delaware,  where 
exposures  were  made  in  unheated  hanger  space  and  at  Pease  AFB,  New  Hampshire,  in  an 
outdoor  environment.  The  other  curve  represents  exposure  at  room  temperature  on  warm  outdoor 
conditions.  The  trends  exhibited  by  the  means  in  the  upper  length  range  are  different  but  not 
proven  significant  in  a statistical  sense.  The  95%  confidence  bounds  for  the  "extreme" 
environment  are  - 0.45  and  for  the  "normal"  environment  are  - 0.33  (in  the  flaw  length  range 
from  0.70"  to  0.80").  The  confidence  bounds  overlap.  The  curves  in  Figure  11-98  depict 
two  probability  moan  trends  for  ultrasonic  inspection  performed  on  Sample  A,  using  two 
different  vendor's  ultrasonic  equipment.  Environmental  conditions  and  the  general  range  of 
technicicn  performance  for  each  were  the  same.  As  in  the  previous  case,  the  trend  of  the 
means  is  different  but  not  significant.  The  95%  confidence  bounds  for  each  curve  in  the  0.45" 
to  0.80"  crack  length  range  is  - 0.16  and  they  thereby  overlap. 
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LEGEND  FOR  DATA  PLOTS 


Sample: 

Method- 

No.  of 
Inspectors: 

No.  of  Flaws: 

Input  Record: 

Confidence 
Level : 

Coefficient  of 
Correlation: 

Coefficient  of 
Determination: 

Standard  Error 
of  Estimate: 

X Axis  is: 

Equation: 


F igure  I 1 


Sample  iype  designations  "A"  through  "F",  described  in  Section  III. 

NDI  Methods,  ET  \cddy  Current  Surface  Scans),  UT  (Ultrasonic  Shear 
Wave),  PT  (Penetrant),  RT  (Radiography),  EH  (Eddy  Current  Current 
Bolt-Hole  Scans). 

Total  number  of  individual  inspections. 


Aggregate  total  of  flaws  in  the  Sample. 

Processing  code  for  data  accession. 

Statistically  calculated  boundary  to  account  for  data 
scalier, 

A measure  of  linear  regression  fit  of  poinf  estimates  in  the  transforma- 
tions X = l/0  / Y =(Lo9  1 ,/p  ) /ac,  where  1.000  represents  an  ideal 
f.t  (See  Section  IX). 

A measure  of  the  point  estimate  regression  fit  to  the  exponential  y = a(x)^, 
where  1 .000  represents  an  ideal  fit  (see  Section  IX). 

A measure  of  deviation  of  point  estimates  fro"  the  I 'near  regression  line 
where  small  values  indicate  low  scatter. 

As  rioted. 

Y = A*X**B:  Line  printer  format  for  the  equation 

y = a(x)k,  Coefficients  A = a and  B = b. 


-1  , Legend  Description  and  Plotring  Format  for  Figure  11-2  through 
11-96. 
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Detect  ion 
Probability 


0.0  | 

0.0  Flaw  Size  (Inches)  1.00 


* Probability  Point  Estimate 
f itted  Curve  P!^t 
■*  Extrapolation 

Upper  Plot  - Estimate  of  the  Mean 
Lower  Plot  - Lower  95%  Confidence  Bound 


F igure  11-1.  Legend  De script  ion  and  Plotting  Format  for  F igure  11-2  through 
(cont'd)  11-96. 
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SAMPLE  I A 
METHOD!  ET 

NO  Of  INSPECTORS:  62 

NO  Of  f LAWS  I *| 

INPUT  RECORD!  01  A ET  1 95  Jo 

CONf IOENCE  LEVELi  .95 

* axis  is  fLAv  raoial  length  iinches), 
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Figure  11-2 
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SAMPLE l A 
MCTMO0I  ET 
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no  or  elamsi  <•) 

INPUT  PECOROl  o2  A ET  1 52  99  95  10 
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Figure  11-3 
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SAMPLE  A 


EDDY  CURRENT  SS 
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Figure  11-4 
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SAMPLE)  * 
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NO  or  INSPECTORS!  SI 
no  or  rtA*r.i  «, 

INPUT  RECOPOl  o<l  A 
CONrtOENCt  LEVEL!  ,96 


ET  1 
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TECH  SKILL  LEVEL  5 SAMPLE  A (ET) 
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SAMPLE  I A 


METHOOl  ET 

NO  or  INSPECTORS!  9 
no  or  ri.*«si  <-i 

INPUT  RECOROt  flS  A ET  1 7 95  10 

CONrtOENCE  LEVEL  I .95 

X AXIS  IS  ELAW  RADIAL  LENGTH  (INCHES). 

TECH  SKILL  LEVEL  7 SAMPLE  * t£T) 
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Figure  1 1-6 
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METHOD!  ET 

NO  OF  INSPECTORS!  |7 
NO  OF  TLAWSI  h\ 

INPUT  RECORD!  flB  A ET  1 jso  250  95  10 
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Figure  11-7 
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Figure  1 1-8 
11-11 


S*MPLC|  4 
MCTMOOl  £t 

N0  or  imspec to»si 

*°  OF  rLAkSl  tJ 
tNPVT  hiC°f,0>  09  A fT  , 
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SAMPLE | A 


METHOD  I ET 

HO  Of  INSPECTORS!  30 
NO  OF  ELAWSI  *1 

INPUT  RECORD!  1 0 A ET  1 000  200  95  10 

CONEIOENCE  LEVEL  I ,55 

x axis  is. elam  raoial  length  (Inches), 
tech  0-200HPS  NDI  TRNG  SAMPLE  A (ET) 
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SAMPLE  A 
EDDY  CURRENT  SS 

TECH  0-200  HRS.  NDI  TRNG. 


0.60 


0 ♦ TO 
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1.00 


SAMPLE I A 
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no  or  inspectors i 10 

NO  Or  Fl*WSI  *1 
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* AXIS  IS  FLAW  PAOIAL  LENGTH  (INCHES! . 
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COEFFICIENT  OF  CORRELATION  • 0.797  COEFFICIENT  OF  DETERMINATION  - 0.777 
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Figure  11-11 
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INPUT  RECOROI  (j  1 A UT  t ?5  10 

CONFIDENCE  LEVEL!  ,T5 

* AXIS  IS  fLAW  RAOUL  lENTTH  (INCHES). 
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SAMPLE  I * 

hctmooi  ur 


NO  OF  INSPECTORS!  52 
NO  OF  Flaws  I *l 

INPUT  MKCOSni  no  A UT  1 011  099  is  '0 

CONFIDENCE  UEvElt  .15 

A AXIS  IS  FLAW  HA01AL  LENGTH  (INCHES). 

TECH, OVER  10  r«s  EXPER,  SAMPLE  A (UT) 

EQUATION  YwA«K»»H  A w 0.7235520-01  8 • 2.23129* 


i 

! 


COEFFICIENT  OF  CORRELATION  - 


0.817 


COEFFICIENT  OF  DETERMINATION  - 0.890 


STANDARD.  THROB  OF  ‘STImaTE  - 


0.  1 1 


1 .00 


0.10 


n.MO 


0.70 


0.00 


0.50 


0.  JO 


O.SO 


0,10’ 


9 9 


MEAN 


• • 


•889 


95%  CONFIDENCE 


SAMPLE  A 

ULTRASONIC 

TECH  OVER  10  YRS.  EXP. 


0.0 


0.0  0.20  0.*0 

0.10  0.30  0.50 

Figure  11-19 
11-22 


0,00 


9. TO 


0,80  1,00 
8.90 


SAMPLE  I * 


METHOD;  UT 

HO  OF  INSPICU’hII  |T 
no  or  FlAMSI  -.1 

INPUT  RECORD)  10  * UT  1 000  200  95  10 

CONFIDENCE  LEVEL)  .05 

X AXIS  IS  FLAW  RA01AL  LENGTH  (INCHES). 

.'ECH  0-200HPS  NO  1 TRNG  sample  A (UT) 

EQUATION  v.AM»»8  A • C.  1*3*100-01  8 ■ 2,910792 


coErr ic ieni  or  correlation  - 0,72*. 

STanOahO  ERROR  of  estimate  - 0,16 

1 .00 

I 

1 

I 

o.vo  . 

I 

I 

1 

1 

0.30  . 

I , 

I .• 

0 • TO 


COEFFICIENT  OF  DETERMINATION  - 0.563 


. • » . 

MEAN 


0.60 


o.so 


0.M0 


0.30 


0.20 


0.10 


95%  CONFIDENCE 


SAMPLE  A 
ULTRASONIC 

TECH  0-200  HRS.  NDI  TRNG 


0,0 


0.20  0.60 

o.n  0.30  o.5o 

Flgura  1 1-20 


0.60 


0.70 


0.80 


0.00 


1.00 


SAMPLE f A 


METHOD  I uf 

NO  Of  INSPECTORS)  jo 
no  or  elaw* i ' «| 

INPUT  PECOPOl  10  A UT  1 500  990  PS  lo 

CONrjOENCF  LEveui  .9S 

* AXIS  IS  FLAW  PADIAl  I.FNOTM  (INCHES), 

TECH  S0C«  mhs  NOI  TSNG  sample  A (UT) 

EQUATION  v.A.«..(*  4 « 0.1U2C3  8 ■ 2,  168064 


^EFFICIENT  OE  CORPELATION  . 0.737  COEFFICIENT  OF  DETERMINATION  - 

STANDARD  ERPOP  OF  ESTIMATE  - 0.13 


1 .00 


0.90 


0.80 


0.70 


0.60 


. SO 


o.*o 


0.30 


0.20 


o.  io 


0.0 


*•  •«  tt  ••  • • 


• • • 


• • • • 


• * 
• • fc. 


MEAN 


95%  CONFIDENCE 

SAMPLE  A 
ULTRASONIC 

TECH  500+  HRS.  NDI  TRNG. 


3.0 


0.10 


0.20 


0.30 


0.*0 


0,50 

Figure  11-21 

11-24 


0.60 


0.70 


0.80 


0.90 


1.00 


f ■ ■ ■ »■■'»  M« 


■>«!•■  U«H 


I >«« mm rnrnrmmm I JU  JW WfPBB^pPlfP 


’R 


SAMPLE!  8 
METHOD  I ET 

NO  0»'  INSPECTORS!  9*. 

NO  OF  FLAWS!  52 

INPUT  RECOROI  ol  11  ET  1 95 

CONE IPENCE  LEVEL!  .05 

* AXIS  IS.  FLAW  RADIAL  LENGTH  (INCHES). 

-wl  TECH.  SAMPLE  B (cT) 


EQUATION  v»A»X»»B 


0.5026130-01  B ■ 1.7*136*. 


COEEE I C I ENT  Of  CORRELATION  - 0.885 


COEFFICIENT  OF  DETERMINATION  - 


0.827 


ST4NCIAR0  ERROR  OF  ESTIMATE  - 

1.00 

I 

I 

I 

I 

o.vo 

1 

i 

l 

0.H0  * 

1 • 

I *• 

t 

I 

0.70  • • • 

I 

I 

I 

I 

C.bO  ♦ 

I 

I 

I . • 

I 

I 

I • • 

I • 

I * 


0 . 1 v 


0.50 


0.«0 


I 

I 

0.30  • 

I 
I 
I 
I 

0.20 

I 

I 

l 
• 
I 
I 
1 
I 


0.10 


0.0 


0.0 


MEAN 


«• 

••  • . • • 

. . 

• *• 

.. 


95%  CONFIDENCE 


SAMPLE  B 
EDDY  CURRENT  SS 
ALL  TECHNICIANS 


0.10 


0.20  O.*0  . 

0.30  0*56 

Figure  11-22 
11-25 


0.60 


0.70 


0.80 


0.90 


1.00 


SAMPLE  I 8 
ME  THOO 1 ET 

MO  OF  INSPECTOPSi  Afl 
NO  or  FLAXSI  52 

input  recqroi  o2  3 et  i ts  99  .9?  to 

COmEIOEnCE  LEvELi  . >s 

* AXIS  IS  FLAW  RACIAL  LENGTH  ( INCHES! . 

UPPER  SO*  ALL  TECH  SAMPLE  8 (ET) 

EQUATION  YmA*x**fl  A « 0.3333210-02  8 ■ 2.69600* 


COEFE I C I ENT  OF  CORRELATION  - 


0,832 


COEFFICIENT  OF  DETERMINATION  - 0.510 


STANDARD  error  of  ESTIMATE  - 0.15 


1.00 

I 

I 

I 

0.90  • 

I 

I 

I 

I 

0,30  • 

I 

I 

I 

I 

0.  TO 

I 

I 

I 

I 

0.60  ♦ 

I 

I 

I 

, I 

0.S0 

I 

I 

I 

I 

0.**0  * 
t 

I 

I 

I 

0.30 

I 

. I 
I 
I 

0.20 

I 

I 

t 

I 

0.10 

I 

I 

I 

I 

0.0 

0.0 


0.10 


0.20 


0,30 


MEAN 


95%  CONFIDENCE 


SAMPLE  B 

EDDY  CURRENT  SS 

UPPER  50%  TECHNICIANS 


O.*0  0,60  0.60  1.00 

0.30  0,70  0.90 

Figure  1 1-23 


1 1 -26 


sample  i a 


METHOOl  ET 

no  or  inspectors!  -o 
no  or  rt*«si  5? 

input  recoroi  o3  a ft  i n ns  io 

coNrintNce  lEveli  .«s 

X A«1S  IS  ELA*  Ni()I»L  length  (INCHES). 

DEPOT  TECH  SAMPLE  « (ET) 

tOuATION  r*A»X**a  A ■ 0.5T0886D-01  8 ■ 1.590*18 


COt rr I C IENT  OP  CORRELATION  - 0.882 


coefficient  or  determination  - o.raa 


STANDARD  ERROR  Or  ESTIMATE  - 0.1* 


1.00 


O.'-iS 


S.fiO 


0.  TO 


0.60 


o.so 


O.mO 


0.30 


0.20 


0.10 


0.0 


I 

I 

I 

I 

• 

I 

1 

1 

I 

I 

I 

1 

I 

I 

I 

I 

I 

I 

1 

I. 

I 

t 

I 

I 

I 

I 

I 

I 

1 

* 

I 

I 

I 

I 

• 

I 

I 

l 

I 

« 

I 

I 

I 

I 

0.0 


MEAN 


• • • * 

• • ....•*•**.*  95%  CONFIDENCE 


SAMPLE  B 

EDDY  CURRENT  SS 
DEPOT  TECHNICIANS 


o,?o 


o.*o 


e.io 


0.30 


Figure  1 1 


0.50 

-24 


0.60 


0 * TO 


0.80 


o.«o 


11-27 


1.00 


SAMPLE i 9 
METHOD  I ET 

MO  O'  INSPECTORS!  13 
MO  or  Elawsi  52 

INPUT  PECOPOl  05  B ET  ! s 
CONEIOENCE  LEVELi  .95 


a AXIS  IS  ELAy  RaOI AL  LENGTH  (INCHES). 

tech  skill  level  s sample  e ieti 
equation  Y.A.X..0  A . 0.56821*0.01 


1.6659** 


COEEEICIENT  OE  CORRELATION  - 

standard  error  or  estimate  - 


COEEEICIENT  OE  DETERMINATION  - 


0.79* 


1.00  4 

I 

I 

I 

0.90 

I 

I 

I 

I 

o.no  . 

I 

I 

1 

0.70 


0.60 


0.50 


0.-0 


0.30 


0.20 


0.10 


MEAN  . 


95%  CONFIDENCE 

• f » 


SAMPLE  B 
EDDY  CURRENT  SS 
TECH  SKILL  LEVEL  5 


SAMPLE  I 8 
mETnOOi  ET 

no  or  inspectohsi  u 
no  or  r^ ams * s? 

INPUT  PECOROl  Ob  1 ET  I 7 
COvriOENCE  LEVEL  I . -JS 

* AXIS  IS  7 LAM  RAOUL  LENGTH  (INCHES), 

TEO  SMLL  LEVEu  7 SAMPLE  8 (ET) 


«5  10 


EQUATION  *«A»xt«8 


COErrictENT  Or  COPPf  L A T I ON 


0.6265000-02  8 ■ 


0,800 


2.5*0263 


coErrtciENT  or  determination  - o.2<>2 


STANOAtO 

1.00 

>.MO 

0.80 

0.70 


PROP  or  ESTIMATE 


0.60 


o.so 


n.*0 


0.  JO 


0.20 


0.10 


0.0 


0.26 


MEAN 


95%  CONFIDENCE 

SAMPLE  B 

EDDY  CURRENT  SS 

TECH  SKILL  LEVEL  7 


0,0 


0,20  0 • *0  0.60  0,66  l.ii 

■MO  0,30  0,50  O.?0  0,«O 


Figure  1 1-26 

11-29 


SAMPLE I 8 
HE TNOO I ET 

NO  or  I NSPCC  TORS  I ft 

NO  or  fLAxSI  50 

INPUT  BECONOI  0 7 8 £T  1 N 

CONFIDENCE  LEVEL-  .05 


A AXIS  IS  ELAN  RAOIAL  length  (InCHESI. 

TECH  OIO  NOT  GRAC.  «S  SAMPLE  8 (ET) 


EQUATION  V.A.X..8  A • 0,2020530-01  8 ■ 


I. 386033 


COEFFICIENT  of  CORRELATION 


COEFFICIENT  OF  DETERMINATION  - 0, 6700-01 


STANDARD  error  of  ESTI-aTE  . 


MEAN 


0.20 

I 


95%  CONFIDENCE 


SAMPLE  B 

EDDY  CURRENT  SS 
TECH  DID  NOT  GRAD  H.S. 


o.*o 

0.30  0.90 

Figure  1 1-27 
11-30 


SAMPLE  I 9 


MET >100 1 ET 

NO  OE  INSPECTORS!  .’.9 
NO  OE  rLA„ 5i  5? 

Input  record i pH  p ft 
COvrioENOE  LEVEL!  .95 


150  250  95 


10 


1 4'1S  IS  EL  Aw  RAO  ILL  I.ENGTM  (INCHES). 
TECm  UNDER  2SVBS  A or  sample  h (ET) 


EOUAT ION  v»A»XwwH 


0.251808D-0I  9 ■ 


2.189283 


coeeeicient  of  correlation 


STanOaa'0  ERROR  of  estimate  - 


: .oo 


0.8T«, 


0.19 


COEFFICIENT  of  determination  - 


0.800 


0.90. 


0.90 


0. 7 C 


0.00 


o.so 


o.-o 


0 . 10 


0.20 


0.  10 


0,0 


0.0 


MEAN 


95%  CONFIDENCE 


SAMPLE  B 

EDDY  CURRENT  SS 

TECH  UNDER  25  YRS.  AGE 


0.19 


0.20 


0.50 


0.30  0,50 

Figure  1 1-28 

11-31 


0.60 


0.  TO 


0 ,8’J 


0.90 


I .00 


w 


SAMPLE  I 8 
METMOOl  £T 

MO  Of  iNSPf CTORSl  29 
MO  or  »u**S!  52 

INPUT  RECQROl  08  9 E T 1 <.00  990  95  10 

CONriOENCE  LEVELI  .99 

A 4 * 1 S IS  fLAW  R40I4L  LENGTH'  (INCHES).  • 

TEC*.  OVER  <*oYR$  4GE  SAMPLE  B (ET) 

EQUATION  taA»x-«9  A * 0.43305*0-01  8 * 1.79*036 


COEPP 1C  I ENT  or  CORRELATION  - 

standard  error  or  estimate  - 

1.00  . 


0.683 

0.19 


COEFr 1CTENT  or  DETERMINATION  - 0.718 


0.90 


C.  TO 


• « • 


MEAN 


O.MJ 


0.50 


o.*o 


0,30 


0.20 


0.10 


95%  CONFIDENCE 

SAMPLE  B 

EDDY  CURRENT  SS 

TECH  OVER  40  YRS.  AGE 


o.o 


0.20  0.*0 

0,10  0.30  0.50 

Figure  1 1-29 
11-32 


0.60 


0.70 


0.80 


0.90 


1.00 


SAMPLE!  a 


METHOD!  ET 

NO  Of  INSPECTORS!  22 
NO  Of  PLANS!  52 

INPUT  RECORD*  OR  « ET  1 OOO  003  NR  10 
CONPIDSNCE  LEVEL!  .V5 

t axis  is  plan  radial  length  (Inches). 

TECH  JYRS  OR  LESS  ExPER,  ..  SAMPLE  B (ET) 

EQUATION  y»A»X»»8  4 « 0. *.0139*0-01  B » 1. 8*198*. 


COEPP ICIENT  Of  CORRELATION  - 


0.856 


COEfPICIENT  Of  DETERMINATION  - 0.789 


bTANOAMO  ERROR  OP  estimate  - 

1.00 


0 . NO 


0. 16 


0 . BO 


0.70 


0.60 


0 , SO 


O.mO 


0.30 


0.20 


0.10 


0.0 


• • • • 


• • , • • •• 


• • 


MEAN 


0.20 


0.10 


95%  CONFIDENCE 


SAMPLE  B 

EDDY  CURRENT  SS 

TECH  3 YRS.  OR  LESS  EXP. 


o.**o 


0.60 


0.3C  0.50 

Figure  11-30 


0 . TO 


0,80 


0.9C 


1.00 


11-33 


SAMPLE  I 8 
METHOOI  CT 

NO  OF  INSPECTORS)  62 
NO  OF  FLAWS)  52 

INPUT  REC'bftOI  09  8 ET  I 011  099'  95  10 

CONFIDENCE  LEVEL)  .95 

* AXIS  IS  FLAm  RaDIAL  LENGTH  (INCHES). 

TECH  OVER  1C  YRS  EXPER.  SAMPLE  8 (ET) 

EQUATION  Y»A»x»»0  A ■ o. 6459580-01  8 ■ 1.814352 


COEFFICIENT  OF  CORRELATION  - 


0,865 


coefficient  of  determination 


0.6)9 


STANDARD  ERROR  OF  ESTIMATE 

1.00 

I 

I 

I 

I 

0.90  ♦ 

I 

1 

I 

I 

o.ao  • 
i 
i 
i 
i 


0.16 


0.70 

I 

I 

I 

I 

0.60  ♦ 
I 

' I 
I 
I 

o.so  * 

I 

I 

I 

I 

0.40  * 

I 
I 
I 
I 

0.30 

I 

I 

I 

I 

0.20  . 
I 
I 
I 
I 


0.10 


0.0 


• • 
• • 


(666 


• 6 • 

• • • 

• 6 

.#  •• 


• • 
I 


MEAN 


95%  CONFIDENCE 


SAMPLE  B 

EDDY  CURRENT  SS 

TECH  OVER  10  YRS.  EXP. 


0.0  0.20  0.40 

0.10  0.30  0 50 

Figure  1 1-31 


0,60  0.80 

0.70  0.90 


SAMPLE  I L 
METHOOt  £T, 

NO  Of  INSPECTORS!  39 
NO  OP  FLAMS!  52 

INPUT  "RECORD I |0  B ET  I 000  200  95  10 

CONFIDENCE  LEVEL!  .95 

A AXIS  IS  PLAN  RADIAL  LENGTH  (INCHES). 

TECH  0-200MRS  NO!  TRNG  SAMPLE  8 (ET) 

EQUATION  v»A*X»»8  a ■ 0.5803660-01  8 ■ 1,5871*7 


COEFFICIENT  OF  CORRELATION  - 0.881  COEFFICIENT  OF  DETERMINATION  - 0.7*2 

STANOARO  EPROQ  OF  ESTIMATE  - 0.1* 

1.00 


0.90 


0.30 


0.70 


• MEAN 


0.60 


0.50 


0.<*0 


0.30 


0.20 


0.10 


95%  CONFIDENCE 


SAMPLE  B 

EDDY  CURRENT  SS 

TECH  0-200  HRS.  NDI  TRNG. 


0.0 


0.10 


0.20 


0.30 


0,*0 


0.50 


0.60 


0.70 


0,80 


0.00 


1.00 


Figure  11-32 


SAMPLE  I 8 

mctmoqi  cr 

NO  Or  INSPECTORS)  i» 
no  or  riAwst  12 

INPUT  RECORD.  ,08  et  I soo  «»  85  10 

CONFIDENCE  LfVELl  ,»5 

' »*is  IS  r LAW  RADIAL  LENGTH  (INCHES), 

TECH' 500*  hr*  no  I T«NO  SAMPLE  B (ET) 


EQUATION  r.A*<(»*a  * . 0.5446030-02  8 ■ 


E. 671400 


COEFFICIENT  OF  CORRELATION 


0.762 


COEFFICIENT  OF  DETERMINATION  . 


0,357 


STANOAMO  FflHOR  of  estimate  - 

i .on  . • 

I 


0.26 


O.NO 


I 
I 
I 
* 
I 
I 
I 

• 1 

0.80 

I 


0,70 


0.60 


0.50 


O.-fl 


0.30 


0.20 


0.10 


0,0 


! 

I 

1 

» 

I 

I 

I 

I 


0,0 


. MEAN 


... 

• • • ••• 


. • • 
• • 


0,10 


0.2" 


0,40 


95%  CONFIDENCE 

SAMPLE  B 

EDDY  CURRENT  SS 

TECH  50(H  HRS.  NDI  TRNG. 


0.30  0,10 

Ptgurt  H-33 


0,60  0,60  1,00 

•«T*  0,60 


n-36 


SAMPLE!  B 
MCTMOOl  RT 

NO  OF  INSPECTORS!  59 
NO  OF  FLAWS!  52 

INPUT  RECORD!  ijl  S RT  l 95  10 

CONFIDENCE  LEVF.Lf  .95 

X AMS  IS  flaw  RADIAL  LENGTH  'INCHES), 

ALL  TECH,,  SAMPLE  8 'RT) 

EQUATION  y»A»x»»B  A « 0.835*380-01  8 ■ 2,196885 


COEFFICIENT  OF  CORRELATION  - 


o.e*2 


COEFFICIENT  OF  DETERMINATION  - 0.699 


STANDARD  ERROR  OF  ESTIMATE  - 


0.2* 


1.00 


0.90 


O.fld 


0.70  . 


0.60 


0.50 


0.»0 


0.30 


0.20 


0.0 


* ♦ ♦ ♦ 


• • • • 


MEAN 


95%  CONFIDENCE 


til* 


SAMPLE  B 
RADIOGRAPHIC 
ALL  TECHNICIANS 


• ••  •• 
• • • 


0.10 


0.20 


0.30 


0.*0 


0.50 


0,60 


0.70 


0.80 


0.90 


Figure  11-34 
11-37 


1.00 


SAMPLE  I 8 


MCTHOOI  RT 

NO  or  INSPECTORS!  23 
NO  or  ri ANSI  52 

INPUT  RECOROI  03  0 «T  1 o 05  10 

CONFIDENCE  LEVEL  I .05 

A AXIS  IS  FLAW  RAOUL  length  (INCHES). 

OEPOT  TECH  SAMPLE  8 (RTl 

EQUATION  A • 0.138011  B > 1.9033A2 


COEFFICIENT  OF  CORRELATION  - 0.8A8 

STANOARO  ERROR  Of  ESTIMATE  - 0.22 


COEFFICIENT  OF  DETERMINATION  - 0.V3O 


1.00 

r 

' i 

i 

i 

0.90 

I 

I 

I 

l 

0.00  . 

I 

I 

I 

I 

0,  TO 

I 

I 

I 

I 

0 . AO 

I 

I 

I 

1 

0 • SO  . 

1 

1 

I 

I 

0 .<.0  . 

I 

I 

I 

I 

0.30  • 

I 

I 

I 

I 

0.20  . 

I 

I 

I 

I 

0.10  . 

I 

• 

i 

I 

fc , ; R - 

o.o 


-v 


• • 


MEAN 


•• 


95%  CONFIDENCE 


SAMPLE  B 
RADIOGRAPHIC 
* DEPOT  TECHNICIANS 


0,10 


0.20 


O.AO  0,40 

0.30  0.50  0,70 


Figure  11-35 
11-38 


SAMPLE  < 9 


METHOD  I ST 

NO  Of  INSPECTOSSI  “*2 
NO  Of  flAWSI  5? 

input  recoroi  o*i  a rt  l *> 

CO'tf  IOEnCE  LEVEL  1 .S5 

T AXIS  15  fLAW  RADIAL  LENGTH  (INCHES!. 

TECH  SKILL  LEVEL  S SAMPLE  B (ST) 


EOUATION  y.A«X»«8 


0 < 88*26*0*0 1 8 ■ 2.15A389 


COtff ICIENT  Of  correlation 


0,85* 


COEfflCIENT  or  determination 


0.TJ5 


STANDARD  ERROR  Of  ESTIMATE  - 


0.23 


1 .00 


g.'JO 


0.H0 


0,  TO 


0.60 


O.SO 


0 • mO 


0.30 


0.20 


0.10 


0.0 


lt(* 


MEAN 


95%  CONFIDENCE 


8 8 8 9 


• *•  • 

• • 

t • » 


SAMPLE  B 
RADIOGRAPHIC 
TECH  SKILL  LEVEL  5 


0.20 


0.10 


a, ao 

0.30  °»59 

Figure  11-36 


0.80 


0.80 


0.T0 


0.80 


1.00 


SAMPLE!  9 
METHOD!  RT 


NO  Of  INSPECTORS!  |'» 

NO  or  FLAWS!  52 

INPUT  RECORD!  05  R RT  1 7 

CONFIDENCE  LEVEL!  .95 


A AXIS  IS  ELAW  RADIAL  LENGTH  (INCHES). 


R5  10 


TECH  SKILL  LEVEL  7 


SAMPLE  9 (RT) 


EQUATION  v«A»X«»B  a • 0. *701130-01  9 • 


COEFFICIENT  OF  CORRELATION 


2.501230 


COEFFICIENT  OF  DETERMINATION 


STANOARO  ERROR  OF  ESTIMATE  - 


till  • 


MEAN 


• • • , • 


95%  CONFIDENCE 


SAMPLE  B 
RADIOGRAPHIC 
TECH  SKILL  LEVEL  7 


Figure  11-37 


v « 


SAMPLE!  B 


METHOD!  RT 

NO  OP  INSPECTORS!  20 
NO  OF  FLAWS!  52 

INPUT  RECORD!  08  9 RT  1 400  990  95  10 

CONFIDENCE  LEvELi  .95 

X AXIS  IS  FLAW  RADIAL  length  (INCHES!. 

TECH  OVER  loVRS  AGE  SAMPLE  B (RT) 

EQUATION  y«A»X*»B  A C 0.141179  B * l. 995176 


COEFFICIENT  OF  CORRELATION  - 


0.713 


COEFFICIENT  OF  DETERMINATION 


0.680 


STANDARD  error  OF  ESTIMATE  - 

1.00 


0.90 


0.23 


0 .BO 


0.70 


0 • NO 


o.so 


0.40 


0.30 


0.20 


o.to 


0.0 


MEAN 


SAMPLE  B 

RADIOGRAPHIC 

TECH  OVER  40  YRS.  AGE 


95%  CONFIDENCE 


3.10 


0.20  0«*0  0,50  0,80  l.OC 

0.30  O.SO  0.70  0.90 


Figure  11-38 
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SAMPLE ■ 8 


METHOD!  BT 

NO  OP  INSPECTORS!  44 
NO  OP  FLAWS!  52 

INPUT  BECOROl  OB  B BT  1 OH  099  95  10 

CONFIDENCE  LEVEL!  .95 

X AXIS  IS  FLAW  RADIAL  LENGTH  (INCHES). 

TECH  OVER  10  YRS  ExPER,  SAMPLE  B (RT) 

EQUATION  y«a«x.»8  A » 0.7049510-01  8 « 2,269053 


COEFFICIENT  OP  CORRELATION  - 


0.852 


COEFFICIENT  OF  DETERMINATION  - 0.696 


STANDARD  ERROR  OF  ESTIMATE  - 

1.00 

I 

I 
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0.90 
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1 
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0.00 

I 
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0.70 
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0.60  . 

I 
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0.25 


MEAN 


o.,o 


.0.30 


0.20 
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ft  . ft 


. • . • • 
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95%  CONFIDENCE 

• « 


SAMPLE  B 

RADIOGRAPHIC 

TECH  OVER  10  YRS.  EXP. 


:.z:  o.*o  o.oo  o.so  1.00 

J.10  0,30  O.SO  0.70  0,90 

Figure  1 1-39 
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SAMPLE  I 8 


METHOOl  PT 

NO  Of  INSPECTORS)  1 i 
NO  OF  fLAMSI  52 

INPUT  PECOPOI  )0  a PT  I 000  200  05  10 

CONFIDENCE  LEVEL)  .05 

* AXIS  IS  FLAW  PAOIAL  LENGTH  (INCHES). 

TECH  0-200 HRS  NO!  TRNG  SAMPLE  fl  (PT) 

EQUATION  y*A»X»#S  1 » C. 4907700-01  8 « 2,353020 


SAMPLE  I C 


HETHOOi  PT 

NO  OF  iNSPECTORSt  63 
NO  OF  PlAWSI  *1 

INPUT  RECORD  1 0 1 C PT  1 95  10 

CONF  IDENCE  LEVEL  I .-5 

X AXIS  IS  FLAW  RADIAL  LENGTH  (INCHES). 

ALL  TECH,  SAMPLE  C (PT) 

EQUATION  v»A»X»«8  A ■ 0.1*25320*01  B • 2,05490* 


COEFFICIENT  OF  CORRELATION  - 0.9*7  COEFFICIENT  OF  DETERMINATION  - 0.715 


STANOARO  ERROR  OF  ESTIMATE  - 0.17 


1.03 


0.90 


0.80 


0,  TO 


0.60 


0.50 


0.40 


0.3C 


0.20 


0.10 


MEAN 


♦ 

95%  CONFIDENCE 


SAMPLE  C 

PENETRANT 

ALL  TECHNICIANS 


0.0 


0.20 

0.10  0.10 


o.*o 


0.60 


0.50 

Figure  11-41 
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1.00 


SAMPLE!  C 


METHOD!  PI  - 
NO Of  INSPECTORS!  3u 
NO  or  PLANS!  41 

INPUT  RECORD!  02  C PT  1 77  99  95  10 

CONFIDENCE  LEVEL!  .95 

X AXIS  IS  FLAW  RADIAL  LENGTH  (INCHES). 

UPPER  SO*  ALL  TECH  SAMPLE  C (PT) 


EQUATION  Y»A»X»»8  A * 0 • 1 040590-05  8 ■ 


4.668 1 OS 


COEFFICIENT  OF  CORRELATION  - 


0,915 


COEFFICIENT  OF  DETERMINATION 


0.452 


STANOARO  ERROR  OF  ESTIMATE  - 

1.00  • •.  . .•«•. 
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UPPER  50%  TECHNICIANS 
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0.10  t'.30  0.50 

Figure  1 1 —42 
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0,  TO 


o.ao 


0.90 


1.00 


SAMPLE!  C 
METHOD  I PT 

NO  Of  INSPECTORS!  35 
NO  OP  FLAWS!  M 

INPUT  RECOROl  03  C PT  1 0 95  10 

CONFIDENCE  LEVEL!  .95 

X AXIS  IS  FLAW  9»0IAL  LENGTH  (INCHES). 

DEPOT  TECH  SAMPLE  C (PT) 

EQUATION  y«A»X»»8  A • 0.2735510-02  8 ■ 2.556170 


SAMPLE  I 


METHOD  I PT 

NO  OP  INSPECTORS!  3 
NO  Or  PLANS!  *1 

INPUT  RECOROI  05  C PT  I 3 9S  10 

CONFIDENCE  LEVEL!  .9S 

X AXIS  IS  flan  RADIAL  length  (INCHES). 

TECH  SKILL  LEVEL  3 SAMPLE  C (PT) 


EQUATION  t»A«X»«9  A . 0.536089D-04  0 * 3.33132? 


COEFFICIENT  OF  CORRELATION  - 0.876  COEFFICIENT  OF  DETERMINATION  - 0.194 


STANDARD  ERROR  OF  ESTIMATE  - 0.32 


1.00  . . *•••  . .A. A.  .A. A .A.  .....................  . 

{ . * MEAN 
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95%  CONFIDENCE 


SAMPLE  C 

PENETRANT 

TECH  SKILL  LEVEL  3 
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SAMPLE  I c 


METHOD  I PT 

NO  Of  INSPECTORS!  *9 
no  or  tlamsi 

Input  RCCOROi  os  C PT  1 S 95  10 

CONFIDENCE  LEVEL!  ,95 

X AXIS  IS  FLAN  RAOIAL  LENGTH  (INCHES!. 

TECH  Sr.lLL  LEVEL  5 SAMPLE  C (PT) 

EQUATION  y«A»X««8  A ■ 0.1637870-01  8 ■ 2,001279 


COEFFICIENT  OF  CORRELATION  - 


0,967 


COEFFICIENT  OF  DETERMINATION  - 0.709 


standard  error  OF  ESTIMATE  - 

1.00 


0.18 
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0.70 
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O.SO 
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TECH  SKILL  LEVEL  5 


o.so 
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0,60 


0,9-3 


I. 00 


Figure  11-45 


SAMPLE i C 


METMOOI  PT 

NO  OP  INSPECTORS!  12 
NO  Of  FLAWS!  m 

INPUT  R£CO«Ol  oS  C PT  1 7 95  10 

CONE IOEnCE  LEVEL!  .95 

* AXIS  IS  fL*M  RAOIAL  LENGTH  (INCHES!, 

TECH  SKILL  LEVEL  7 SAMPLE  C (PT) 

EQUATION  y»A»X»«8  A ■ 0.A80545D-C3  8 ■ 3,215131 


COEFf ICIENT  Of  CORRELATION  - 0,968 

STANDARD  ERROR  Of  ESTIMATE  - 0.22 


COEFFICIENT  OF  DETERMINATION  - 0.321 


1.00 


0.90 


0.S0 


0.»0 


0.60 


o.so 


• • • 


MEAN 


95%  CONFIDENCE 


J.40 


SAMPLE  C 

PENETRANT 

TECH  SKILL  LEVEL  7 


0,0 


0,20  0.60 
0.10  0,30  9,50 

Figure  11-46 
11-49 
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SAMPLE  I c 


METHOD  I PT 

no  or  inspectorsi  5 

NO  or  rLAMSJ  *1 

INPUT  OCCOPDI  g 7 C PT  l * 
CONFIDENCE  LEvELi  ,9S 


95  10 


* AXIS  IS  FLAW  RADIAL  LENOTH  (INCHESI. 

TECH  OIO  NOT  GRAO,  HS  SAMPLE  C (PT) 


EQUATION  y»a«x**8  a » 0.8070360- ON  8 ■ 


A. 209194 


COEFFICIENT  OF  CORRELATION  - 


COEFFICIENT  OF  DETERMINATION  - 0.360 


STANDARD  ERROR  OF  estimate  - 


• • • <• 


n 0,20  0.40 

0.10  0,30 


MEAN 


95%  CONFIDENCE 


SAMPLE  C 


PENETRANT 

TECH  DID  NOT  GRAD  H.S, 


0.50  8,40  0.70  0,80 


Figure  1 1-47 
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SAMPUl  C 


mEThdOi  PT 

no  of  i '(spec top* i is 

NO  OF  FLAWS!  4] 

INPUT  RECORD!  ofl  C PT  1 ISO  jso  95  10 

CONFIDENCE  LEVEL!  .*5 

a axis  is  flaw  radial  length  (Inches). 

TEC-  UNDER  2SYRS  AGE  SAMPLE  C <PTI 

EQUATION  Y«A»x.#B  a « 0,5692310-01  9 ■ 1.S08703 


COCFF  ICIENT..OF  CORPELATION  - 


STANDARD  ERROR  OF  ESTIMATE  - 

1.00  . • 


0.059  . COEFFICIENT  OF  DETERMINATION  - 0.259 

0.29 


0.90 
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0.50 
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SAMPLE  C 
PENETRANT 

TECH  UNDER  25  YRS.  AGE 


0.0 


0.0-- 


0.10 


0.20 


0.30 


. o.*o 


0.50 

Figure  11-48 
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SAMPLE  I c 


ME  I MOO  I PT 

NO  OF  INSPECTOPSI  18 

no  or  f lamsi  «i 

INPUT  MECO^OI  o H C PT  1 <,00  990  95  10 

CONEluENCt  LEVEL  I . '9 

» Axis  IS  ELAM  9»01'L  length  (INCHES), 
tech  OVEW  ••0YOS  AGE  SAMPLE  C (PT) 

EQUATION  r«A»*»«8  A • 0. <.185660-02  8 m 2.528868 

COEFFICIENT  OE  COBPELaTION  - 0.968  COEFFICIENT  OF  DETERMINATION  - 0.663 


MEAN 


95%  CONFIDENCE 


SAMPLE  C 
PENETRANT 

TECH  OVER  40  YRS.  AGE 


0.0 

0.10 


a.  jn 


0.20 


SAMPLE  I C 


MtTMOOl  P T 

NO  or  I NSPCC  T OWS  I ->3 
NO  or  fl*wS«  »i 

INPUT  RfCDHPI  (IN  V PT  1 011  099  NS  10 

CONFIDENCE  LEVEL  i 

a a»is  is  ru*«  radial  length  (Inches). 

TECh  OVER  10  YRS  EXPEM.  SAMPLE'  C (PT) 

EQUATION  Y.A«*«»8  A • 0.16<.7?70-0l  8 ■ 2,007067 


coefficient  or  correlation  - 


0.951 


cocrnciENT  or  determination 


0.716 


standard  error  or  estimate 


0.17 


I . 0 0 . 


0 , NO  • 


0,80  • 


0.70  . 


0,60  * 


o.so 


0 . *•  0 * 
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MEAN 


95%  CONFIDENCE 


SAMPLE  C 
PENETRANT 

TECH  OVER  10  YRS.  EXP. 


0.0 
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0.20  0.*0 

0,10  0,30  0 ,S0 

Figure  1 1 -50 
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11-53 


1.00 


SAMPLE i C 


METMOOl  PT 

no  or  inspectopsi  ,>e 
no  or  plawsi  »i 

INPUT  »ECOPOl  IP  C PT  I 000  200  95  10 

cosmcNce ‘utvEu 

* **IS  IS  FLAW  PAD  I A L LENGTH  (INCHES). 

Tt'Cx  0-200MRS  no:  TPNG  sample  C (PT) 

EQUATION  y.Aa*.#8  A a 0,2963060-03  U • 3,311321 


COtrriciENT  or  CORRELATION  - 0,9*2 


cocrrtciENT  or  oetebmination  - 0.351 


5TANOAWO  EPPOP  or  ESTIMATE 


0.22 


1 . 00 


0,90 


0.  JO 


0.  TO 


0.60 


0.50 


0,-0 


0.30 


0.20 
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95%  CONFIDENCE 


SAMPLE  C 
PENETRANT 

TECH  0-200  HRS.  NDI  TRNG. 
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Figure  11-51 
11-54 


SAHPltl  C 


j 


MtTMOOi  PT 

NO  or  imspcctowsi  * 

NO  Of  •*  1 

INPUT  Of  COMO  I to  PT  l soo  9‘f'l  10 

ooNrtocvcf  ifvtu  .o*i 

* AMS  IS  M Aw  MAIM  A.  I * NOTH  MNCMtS). 

TtCH  nou*  H**  NO  1 T»NG  SAMPtf  c <MT) 

eOUAT^JN  v»A*A«*H  a • 0,3*673*0-0*  6 « 

i 

COtrriCltHl  or  COW«rcAT|0N  . 0 • tf  5?  COfrriCJCNT  or  OCTCMMlNATIO*  - 0,*73 


StANOAMO  t MPOM  or  t '»  T | MA  T £ 

l . JO  • • • . • 

l • 

1 • 

I 

.' , V 0 ♦ • 

I • ft 

t 

I 

] 

l’  . !<  0 • 
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I * 
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O. 70  • 
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I • » » 
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■7  . (*  0 • . 

1 • « 
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t 

I • 

o.so 

I 

.1 . 0 • 

I 

I 

l 

P. JO  • 

I 

I 

I 

I 

o.«?0 

I 

1 

I 

0.10 


MEAN 


95%  CONFIDENCE 


SAMPLE  C 
PENETRANT 

TECH  50CH-  HRS.  NDI  TxNG. 


SAMPLE  I C 

netmooi  ur 

NO  Of  INSPECTORS!  33 
no  c r ri. « ws  • 

INPUT  »£CORO I 01  C UT  l 95  Jfl 

COST IOENCE  LEVEL I ,9b 

x axis  is  ela*  racial  length  iinchesi. 

*LL  TECH,  SAMPLE  C (UT) 

EQUATION  y«».«..b  * « 0.1031T7  8 . 1.163271 


COEFFICIENT  Of  CORRELATION  - 0.718 

STANOARO  I HROH  Of  ESTIMATE  - o.ll 

1.00 

I 

1 

I 

I • 

0.90  . 

o.*o 

0 . TO 

0.60 

0.50 

0.«.0 

0.30 

0.2C 


COEfflCIENT  Of  DETERMINATION  - 0.717 


MEAN 


95%  CONFIDENCE 


SAMPLE  C 
ULTRASONIC 
ALL  TECHNICIANS 


0.10 


0.0 


0. 


0.20  0.*>0 

o.io  0.30  0.50 

Figure  11-53 
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SAMPLE  I C 


nCtnooi  ut 

no  or  inspectors!  ta 
no  or  'lAksi  *i 

INPUT  we  COHO  < 0 £ C UT  1 «i  «>l  95  10 

CONr ICE NCE  Ltvlu  ,«s 

A AA  I 5 IS  rUAK  QaOIAL  t;.N3TM  llNCHESI. 

UPPEM  SO*  all  UCm  SAMPLE  C (L)T) 

EQUATION  T.A»«..B  A . 0.16B33TO-0*  B • 3.T18«I 


COErriCIfNT  Of  COBBELA  T 1 ON  - 


o.**« 


COEfflClENT  Of  OETEBmJNATION 


0.359 


STANOA^O  EQMOW  Of  ESTIMATE  - 

I .00 


o.u 


0.90 


0.00 


0.  TO 


0.00 


o.so 


O.NO 


0.3C 


0.10 


0.10 


0.0 


...  • 


0.0 


0.10 


O.iO 


0.*0 


MEAN 


95%  CONFIDENCE 


SAMPLE  C 

ULTRASONIC 

UPPER  50%  TECHNICIANS 


0.30 


0.50 


0.60 


0.  To 


o.ao 


0.90 


i.oo 


Figure  11-54 
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JAmPLEI  t 


METHOD l Uf 

no  or  i nspec  tors  i 10 

NO  Of  ftA»SI  -1 

INPUT  PfCONPl  OJ  C i.T  1 0 «S  10 

CONflOENCE  LEVEL  I .95 

» »*IS  IS  fL*»  M*0!*L  LENGTH  ( INCHES! • 

DEPOT  TECH  SAMPLE  C (U'ft 

EOUATTON  T.*»n..a  A * 0.8412690-01  6 • 1,029217 


COE f f I C I ENT  Of  CORRELATION  - 0.505 

STANDARD  ERROR  Of  ESTIMATE  - 0.18 

1 ,00  • ' • 


J.oo 


0.80 


0.70 


••  • * ••  • «•  • • 


COEff IC1ENT  Of  DETERMINATION  - 0.105 


MEAN 


0.60 


O.M. 


o.-c 


0.  JO 


0.20 
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95%  CONFIDENCE 


SAMPLE  C 

ULTRASONIC 

DEPOT  TECHNICIANS 


0,0 


0.0 


0,10 


0.20 


0.40 


0.30 


0.50 


0,00 


0.70 


0.80 


0.00 


1.00 


Figure  1 1-55 
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SAMPLE  I C 


«£  t«00 I uT 

no  or  inspectopsi  ,;e 

no  or  *t 

INPUT  NttOMOl  0 •i  C uT  1 S VS  1 0 

COvriOENCt  LEVCLI  , )T 

« *«IS  IS  r^Ah  (l*OI»L  lEN&Tm  ijNCMtS). 

HC»  SKILL  LEVEL  S SAMPLE  c lUTl 

EQUATION  Y»A«*««9  A ■ 0, 1*1933  9 ■ 1.0309?) 


COfrriciENT  or  COPKfLA TiON  - 


a.  730 


coErr icient  or  determination  - o.tes 


STAND A WO  EWHOP  or  ESTIMATE  - 


o.  n 


l.oo 
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0.90  » 
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0.90  • • 


0.  TO 


0.60 


o.so 


0.-0 
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o.?o 


0.10 


MEAN 


95%  CONFIDENCE 


SAMPLE  C 
ULTRASONIC 
TECH  SKILL  LEVEL  5 


0.0 


0.0 


o.io 


o.?o 


0.30 


0.*0 


O.SO 


0.60 


Figure  11-56 
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00 


SAM»!.E  I C 


NtTwOOl  I'T 

SO  Of  INSPECTORS!  7 

SO  Of  rL*«SI  «•( 

ISPcT  «tC0«0!  (iS  0 :;T  i 7 *5  10 

f OsflOtMCE  UlfLl  , s 

l A»1S  IS  rLA4  RAOUL  LfSuTH  lISCHES). 

’EC*  SMLL  LfVf.  7 SAMPLE  C (UT| 

eclatios  t«a»i»»b  a • o. la'Jsjso-.oi  h • 3,124*93 


COfrr ICIEST  Of  CO«»£LATION  - 0.429 


coerriciENT  or  determination  - 0.207 


standard  error  or  estimate  . o,28 


i.or-  • * 

I ‘ ‘ .MEAN 
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* * • 
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0 • »•  n 


95%  CONFIDENCE 
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SAMPLE  C 

ULTRASONIC 

TECH  SKILL  LEVEL  7 
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Figure  1 1-57 
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SAMPLE  I r 


M£  ThOO*  ul 

NO  OF  InSPECTOBSi  .0 
NO  OF  r-  i_  * w S I *j 

INPUT  •JfCOBDi  08  UT  S ISO  250  95  10 

CONFIDENCE  UvEui  . J5 

» l»!5  1 S FU*«  0»OI  -L  LENGTH  (INCHES). 

TEC*  j.NPEw  JST6S  1GE  SAMPLE  C (UT) 

EQUATION  y»A»aa«9  i • 0.180866  B » 1.123296 


COEFFICIENT  OF  COBBFLiTION  - 


0.8*8  COEFFICIENT  OF  OETEBmI NATION  - 0,696 


STAVJAUO  EBBOB  OF  ESTIMATE  - 


0.13 


1.00 


0.50 


0.60 


• • 


0.  TO 


0.60 


0.50 


,,  ■ • • * 
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.*0 
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95%  CONFIDENCE 

SAMPLE  C 
ULTRASONIC 

TECH  UNDER  25  VRS.  AGE 
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0.10  0,30  0,50 

Figure  11-58 
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SAMPLE  i c 


METHOD l UT 

NO  Of  INSPECTORS!  S 

no  or  r lam!»i  m 

INPUT  RECORD!  08  C UT  1 *00  990  95  10 

CONf IDENCE  LEVEL!  .95 

X AXIS  IS  FLAM  RAOIM.  LENGTH  (INCHES), 

TECH  OVER  AOYRS  AGE  SAMPLE  C (UT) 

EQUATION  Y«A»X»«H  A * 0.1831060-02  8 ■ 2,266012 


COEFFICIENT  OF  CORRELATION  - 0,177  COEFFICIENT  OF  (.^TERMINATION  - 0,100 

ST*NOARO  ERROR  OF  ESTIMATE  - 0. AO 
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SAMPLE  C 
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Figure  11-59 
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SAMPLE  I c 
METHOD  I UT 

NO  Of  INSPECTORS!  30 
NO  or  ELAMS  I A 1 

INPUT  RECORD!  09  C UT  l OH  099  95  10 

COVEIOENCE  LEVEL i .95 

* aiis  is  elam  radial  lenoth  unchesi. 

TECm  over  10  yos  E*P£R.  SAMPLE  C (UT) 

EQUATION  Y.A»*..B  A ■ 0.120915  B • 1,05677* 


COEEE ic IENT  or  CORRELATION  - 

STANCARO  ERROR  Or  ESTIMATE  - 

1.00 
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Figure  11-60 
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SAMPLE i c 
METHOD!  UT 

mo  or  inspector  n 
MO  or  PLAMSI  M 

INPUT  RECORD!  jO  C UT  1 000  200  95  10 

CONFIDENCE  LEVEL!  .95 

X AS  I S IS  FLAM  RAOI*L  LEMOTm  (INCHES). 

TECH  0-200H«s  NO  I TRNQ  SAMPLE  C (UT) 

EQUATION  y»A*X**8  A • 0.221678  8 ■ 0.832286 


COEFFICIENT  OF  CORRELATION  - 0.697  COEFFICIENT  OF  DETERMINATION  - 0.398 

STANOARO  ERROR  OF  ESTIMATE  - 0.15 

1.00  . 
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Figure  11-61 
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SAXPU  I C 


MtTHOUt  UT 

NO  Of  INSPECTOHSI  0 

NO  Of  f LAWS'  *1 

input  MCCOHOl  jO  C IJT  ( SOO  '*')')  NS  10 
LONMOINCF  UvELl  .0% 

X AXIS  IS  FLAW  MACML  LENGTH  (INCHES), 

tech  son*  m«s  nih  tmno  samplf  c tun 

eoo*tion  t . a,w7?in-o*  u ■ j.MiaoT 


COEfriClENT  Or  COMPEL *T ion  - O.AOl 


cotrriciENT  or  determination  - o.u* 


STANOAPO  EMMOM  Or  F ST  I MATE 

l .00 


0.«!l 


o.od 


0.00 


0.  TO 


0 ,6<l 


0 .so 


o.-o 
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0^0 
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Figure  1 1-62 
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SAMPLE  C 
ULTRASONIC 

TECH  50CK  HRS.  NDI  TRNG. 
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o.*o 


1.00 


sample  i i 


METMOOl  Cm 

MO  or  INSPECTOWSi  5 0 7 
MO  or  FLAWS  I A 

Input  »econoi  01  e r*  i os  10 

confidence  Liven  .os 

a »*I5  is  flam  «o«t  irNOTH  (Inches), 
all  tec*.  sample  e iem> 

EQUATION  y.A«X«»0  A « O.ilATIU  H « t.^T2TB| 


COEFFICIENT  or  COPHELATION  - 


0,896 


coErr tc l ent  or  determination  - 


0,696 


stanoaho  error  or  estimate 

i ,oo 
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0.13 
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o.  ro 
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SAMPLE  E 
EDDY  CURRENT  BH 
ALL  TECHNICIANS 
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Figure  1 1-63 
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SAMPLE i E ' * 

MCTMOOl  EM  ''t 

NO  Or  INSPECTORS!  s;  ; 

NO  or  rLAMSI  6 

INPUT  RECORD  I 03  E EH  J 0 «5  10 

covrioENcr  level(  .95 

X Axis  IS  Flaw  8oR£  LENGTH  (INCHES). 

OEPOT  TECH  SAMPlF  £ (EH) 

equation  y»a.x..8  a . 0.173*39  a ■ 1.25*267 


COErnciENT  or  cuarelation  - 

stanoaro. error  or  estimate  - 

1.00  . 
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95%  CONFIDENCE 
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SAMPLE  E 

EDDY  CURRENT  BH 

DEPOT  TECHNICIANS 
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Figure  11-64 
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SAMPLE l E 


METHOOl  CH 

>.6  Of  INSPECTORS)  5 

MO  Of ■ ruAWSI  6 

INPUT  BECOROI  05  E EM  2 3 95  10 

confidence  i.eveu  .95 

X AXIS  IS  I'LAX  riO«£  LENGTH  (INCHES). 

TECH  SKILL  LEVEL  3 SAMPLE  C ICH) 

EQUATION  V»A*X«<*8  A » 0,*42<*32  8 • 1,120549 


COEf f I CIENT  Of  CORRELATION  - 


0,824  cocrrictENT  or  determination  - 0.466 


STANOARO  ERROR  Of  ESTIMATE  - 0.10 
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Figure  11-65 
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SA-PLEi  c 
MITNOOl  EM 


NO  or  INSPECTORS)  4 3 

no  or  riAtfsi  6 

INPUT  PECOROI  OS  E eh  l 5 95  10 

CONEIOENCE  LEVEL)  ,i5 

X »XIS  IS  rv.»»  8(jflc  LENGTH  (INCHES). 

TtCH  SKILL  LEVEL  S SAMPLE  E (EH) 

EQUATION  r«A*X»>8  A ■ O.JOJTOS  8 ■ 1,2*168$ 

coErr ic ient  or  compilation  « o,a$i  ccErrictENT  or  determination  - 0,6*1 


stanoapd  eppop  or  estimate 

l.oo 
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o.i* 
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SAMPLE  E 
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Figure  11-66 
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SAMPLE  I £ 


MCTmCOI  £H 

mo  or  imspectossi  is 
no  or  rj*wsi - » 

INPUT  RCCOROl  OS  t £N  j lo 

CONriOEMCE  LC  VtL  t ,V5 

X Alls  IS  FLAW  Bn«t  LENGTH  ( INCHES!  . 

TEC“  SKILL  LEVEL  7 SAMPLE  E (EH) 

EOUATION  ».A»X»*8  * • 0.109398  fl  • 1,6*20* 


cocrricitNT  or  correlation  - 


0,896 


cocrricilNT  or  determination 


0,605 


STANDARD  EHHOB  Or  ESTI“aTE  - 
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TECH  SKILL  LEVEL  7 
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Figure  1 1-67 
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SAMPLE  I £ 

METHOD  I EH 

NO  OF  INSPECTORS!  11 
NO  Or  FLAWS!  6 

INPUT  PECOHOl  07  £ EH  2 N 95  10 

confidence  leveli  .95 

X AXIS  IS  flan  80»E  length  (INCHES). 

TECH  OIO  NOT  GRAD.  HS  SAMPLE  E (EH) 

EQUATION  Y»A»x»»8  A ■ 0.1*1717  8 « 1,50615* 


COEFFICIENT  OE  CORRELATION 

STANDARD  ERROR  OE  ESTIMATE 

1.00 


0.90 


0.766 


0.19 


COEFFICIENT  OF  DETERMll.ATION  - 0.5*2 
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0.*0 
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EDDY  CURRENT  BH 
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Figure  11-68 
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SAMPi  r | i 

KTNOOl  £h 


no  or  issptcronsi  a 
no  or  elans)  6 

Input  recoroi  os  £ eh  ? 150  jso  9S  io 

CONPIDEmCE  LEVEL i ,JS 

* A«IS  t > EL»W  80«f  LENGTH  (INCHES). 

TECH  UNO CP  J5TBS  AGE  SAHPlE  E <£h) 

EQUATION  v«A»i.«g  A ■ 0.52T663  8 • 1.031128 


cocrriciENT  or  correlation  - o,938  corrriciENT  or  determination  - o.aoa 

standard  error  or  ESTIMATE  - 0.08 
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Figure  11-69 
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SAMPLE  I C 


MfTMOOl  CM 

NO  OF  INSPECTORS)  Jl 
no  or  flansi  6 

INPUT  RECORD)  C*  £ £M  2 *00  990  95  10 

CONFIDENCE  LE  V£.L  I .->5 

A AMS  IS  ri_Aw  9o»£  LENGTH  (INCHES). 

TtCH  oves  *or«S  AGE  sample  £ IEm) 

EQUATION  r.A»*»»B  A « 0.2*0165  8 « 1.258933 


COEFFICIENT  Of  CORRELATION  . 0.766 


coefficient  or  determination  - 0.003 


STANOARO  ERROR  OF  ESTIMATE  - 0.15 


1.00 
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0,3  0 


0.  TO 


0.60 


a.  so 
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SAMPLE  E 
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Figure  11-70 
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SAMPLE!  £ 


MCTHOOI  EH 

no  nr  inspectors!  :o 
no  or  rLAMSi  6 

JNPut  RECOPOI  op  E eh  2 000  003  Op  10 

CONE10ENCE  LEVEL!  .95 

X AXIS  IS  ELAM  BoPC  LENGTH  (INCHES). 

TECH  JYPS  op  LESS  ExP£P.  SAMPLE  E (EH) 

EQUATION  Y.A*x..e  1 ■ 0.339759  8 ■ 0.903935 


coErr icient  or  coppelation  - o.69* 

STANOAPD  EPPOP  OF  ESTIMATE  - 0,1* 


coerrictcXT  or  determination  - o.ats 


1.00 


0.90 


0.3C 


0.T0 


0.00 
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SAMPLE  E 

EDDY  CURRENT  BH 

TECH  3 YRS.  OR  LESS  EXP. 
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o,*o 
Figure  I 
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SAMPLE l £ 


METHOD  I Eh 

NO  OP  INSPECTORS!  71 
no  or  rt*HSi  « 

input  PECOPOI  09  £ EM  2 011  090  95  10 

CONFIDENCE  LEVEL)  .95 

X 4X15  IS  FLAW  BORE  LENGTH  (INCHES! . 

TECH  OVER  10  VR5  EXPE9.  SAMPLE  £ (EH) 

EQUATION  y»A»x»»8  A * 0,1*8162  B ■ 1.352766 

COEFFICIENT  OF  CORRELATION  - 0.936  COEFFICIENT  OF  DETERMINATION  - 0.762 


STANOABO  ERROR  OF  ESTIMATE  - 
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Figure  11-72 
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SAMPLE  I £ 

METHOD  I £H 

NO  Of  INSPECTORS!  <.8 
NO  Of  FLAWS)  6 

INPUT  flECOROl  10  E £H  2 000  200  9$  10 

CONFIDENCE  LEVEL)  .95 

X AXIS  IS  FLAW  BORE  LENGTH  (INCHES).. 

TECH  0-200HRS  NO  I TRNG  SAMPLE  E (EH) 

EQUATION  Y*A*X#*B  a ■ 0.172014  B ■ 1.248150 


SAMPLE!  £ 


METHOD  I Em 

NO  OE  INSPECTORS!  IT 
NO  or  ELAMS!  6 

INPUT  RECORD!  10  E EH  i 500  009  «5  10 

CONEIOCNCE  LEVEL ! .VS 

* A*rs  is  elaw  bo»e  length  (Inchesi. 

Tech  500 ♦ HRS  NJI  TPNO  SAMPLE  C <1M| 


EQUATION  Y»A»T»«H  A • 0.180351 


a • 


1 . *13530 


COEEE 1 0 I ENT  OE  CORRLLA  T I ON  - 


0.930 


cocrricitNT  or  oetermination 


O.TfO 


STANOARO  ERROR  OE  ESTIMATE  - 
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TECH  500+  HRS.  NDI  TRNG. 
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Figure  11-74 
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SAMPLE  I r 


METHOD  1 EH 

HO  Of  INSPECTORS)  79 
NO  Of  f LAWSI  3* 

INPUT  RECOROi  01  f Eh  2 05  i0 

CONf IOENCE  LEVEL i . iS 

* AXIS  15  fLAw  eost  LENGTH  (INCHES). 

ALL  TECH.  SAMPLE  f (EH) 

EQUATION  Y«A*x**8  A • 0.376160  8 • 1.1*1222 


COEPP IC IENT  OP  CORRELATION  - 0,960 

STANDARD  error  OP  estimate  - 0.06 

1.00 


COEPPICIENT  OP  DETERMINATION  - 0.965 
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Figure  11-75 
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SAMPLE  I r 


METHOD  I EH 

NO  Of  INSPECTORS!  39 

no  or  riA*si  3* 

INPUT  RECORD!  02  r EM  2 | T 09  9*  10 

CONFlbENCE-  LEVEL!  ,9'.<  . 

* axis  is  flaw  some  length  iinchfsi, 

UPPER  50*  «UL  TFCH  SAMPLE  f ( EM  I 

EQUATION  y.A»X««B  A • 0.22*1*0  B • 1.219797 


coErrictENT  or  correlation  - 


0.9*6 


COEFFICIENT  OF  DETERMINATION 


0.935 


STANOARO  ERROR  OF  ESTIMATE  - 
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Figure  1 1-76 
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sample  i r 


METMCOI  Em 

NO  Of  INSPECTORS!  *7 
NO  Of  FLAMS!  3* 

INPUT  RECOROl  03  f EM  <f  0 9<1  10 

CONFIDENCE  LEVEL!  .95 

* AXIS  IS  FLAM  BORE  LENGTH  (INCHES', 

OEPOT  TECH  SAMPLE  F (EH) 

EQUATION  V.A«X»«B  A > 0,302712  8 ■ 1,211781 


COEFFICIENT  OF  CORRELATION  - 0,912 


COEFFICIENT  OF  DETERMINATION  - 0.932 


STANOARO  ERROR  OF  ESTIMATE  - 

1.00 
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Figure  11-77 
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SAMPLE  I T 


nEThoci  Eh 

NO  Of  INSPECTORS  I (,» 

NO  Of  ri_*»SI  3* 

iNPfT  WECOBOI  05  r Eh  2 5 

CONf !Ofc NCt  LEVEL!  . :S 

* **ts  is  rL*n  Hoot  length  (Inches), 

TECh  SKILL  LEVEL  S SAMPLE  f (EH) 


equation  v«a»x*#B 


0. 35?a3«  8 • 1.188885 


CO£rf[CIENr  Of  CORRELATION  - 

STANCiBO  EBBOB  Of  ESTIMATE  - 
I .JO 


0.90 


0.9*’ 


0,08 


COEfflCIENT  Of  DETERMINATION  - 


0.952 


'.so 


0.70 


0.00 


o.sd 


o.-o 
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SAMPLE  F 

EDDY  CURRENT  BH 

TECH  SKILL  LEVELS 


MEAN 


**♦♦♦88 
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95%  CONFIDENCE 
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n*0  0.20  0.AO 

f«10  0,30  0 .50 

Figure  1 1-78 
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SAMPLE  I T 


HETHOOI  EH 

NO  or  INSPECTORS’  13 
no  or  rt,Awst  3* 

input  SECOMOt  05  r EH  2 7 <>*  (0 

CONEIOENCr  LEvELl 

X Axis  IS  ri.A*  BoPE  LENQTh  (INCHES). 

TECH  SKILL  LEVEL  ? SAMPLE  r (EH| 

EQUATION  r«A»X»«B  A ■ 0.5605*5  B ■ 1.1*383* 


coErriciENT  or  correlation  - o.sbo 

stanoamo  error  or  estimate  - 0.10 

1.00  . 
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Figure  11-97.  Probability  of  Detection  Versus  Fatigue  Crack  Radial  Length,  Radiographic  NDI  for 
Cracks  around  Countersunk  Fasteners,  Skin  and  Stringer  Wing  Segments,  Sample  B - 
for  Normal  and  Extreme  Outdoor  Weather  Conditions 
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^igure  11-98.  Probabil ity  of  Detection  Versus  Fatigue  Crock  Radial  length.  Ultrasonic  Shear  Wave 
Scans  Around  Countersunk  Fasteners,  Skin  and  Stringer  Wing  Assembly,  Sample  A - 
for  Ultrasonic  Instruments  of  Two  Different  Manufacturers 
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SECTION  XII.  CONCLUSIONS  AND  RECOMMENDATIONS 


This  program  was  designed  to  measure  the  overall  performance  of  nondestructive  inspections 
currently  employed  by  the  United  States  Air  Force  in  maintenance  of  aircraft  structure  both 
at  field  and  depot  locations.  The  primary  intent  was  to  quantitatively  measure  the  reli- 
ability of  NDI  to  detect  service  induced  cracks  in  aircraft  structure.  There  was  also  an 
opportunity  luring  the  program  to  observe  and  record  data  on  many  variables  associated  with 
the  NDI  process,  such  as  human  factors,  environment,  and  equipment  operation . 

The  o/erall  results  of  initial  analyses  of  the  data  are  presented  graphically  in  Section  X, 
while  more  detailed  analyses  with  regard  to  selected  variable  are  presented  in  Section  XI. 
This  Section,  XII,  provides  a commentary  on  the  results  of  the  analyses  and  observations 
made  in  the  data  acquisition  phase  of  the  program.  Because  of  the  exceptionally  large 
amount  of  data  acquired  during  the  course  of  the  program  and  the  potential  impact  that  it 
will  have  on  the  technology,  additional  analyses  and  data  treatments  outside  the  scope  of 
this  program  may  extend  the  conclusions  and  recommendations  presented. 

The  current  program  conclusions  ore  first  discussed  in  terms  of  observations  of  the  data  within 
the  context  of  current  practices  of  general  nondestructive  inspection  technology  within  the 
Air  Force  today.  Secondly,  conclusions  of  a specific  nature  are  discussed  in  terms  of  the 
data  provided  in  Section  X,  which  depicts  overall  findings  derived  from  the  NDI  method/ 
structure  combinations  employed  in  this  program  and  each  of  the  more  detailed  analysis 
categories  developed  in  Section  XI . Then  a number  of  recommendations  based  on  both  data 
analyses  and  observations  made  in  the  course  of  data  acquisition  are  provided. 


GENERAL  CONCLUSIONS 


The  overall  reliability  of  nondestructive  inspections  currently  used  by  the  Air  Force  and 
evaluated  in  this  program,  falls  below  that  which  has  been  assumed  or  generally  desired. 
The  measured  probabilities  of  detecting  fatigue  cracks  in  built-up  aircraft  structure  using 
typical  maintenance  inspection  techniques  and  procedures  are  not  as  high  as  most  designers 
and  structural  engineers  would  prefer  and  certainly  not  as  good  as  those  responsible  for 
aircraft  maintenance  and  safety  would  expect.*  The  results,  however,  are  not  surprising 
to  many  of  those  closely  associated  with  applications  of  nondestructive  inspections  and  the 
data  substantiates  many  opinions  previously  expressed  regarding  current  NDI  reliability. 


*Military  specification,  MIL-A-83444  (USAF),  "Airplane  Damage  Tolerance  Requirements", 
states  that  in-service  inspections  (at  a depot  or  base  level)  are  assumed  capable  of  defect- 
ing cracks  of  0.25  inch  uncovered  length,  emanating  from  one  side  of  a hole,  if  the 
material  thickness  is  equal  to  or  less  than  0.25  inch.  Similarly,  a quarter-circular  corner 
crack  of  0.25  inch  uncovered  length  applies  for  material  thicknesses  greater  than  0.25  inch. 
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Of  foremost  importance  is  the  realization  that  the  previously  established  90-95  percent  reli- 
ability criteria  (90  percent  probability  of  detection  with  a 95  percent  confidence  bound) 
cannot  be  attained  with  normal  inspection  methods.  With  the  exception  of  fiuorescenr 
penetrant  inspection,  the  NDI  techniques  employed  in  the  program  demonstrated  considerable 
difficulty  achieving  a 50  percent  probability  of  detection  for  a 1/2-inch  crock  size  with  a 
95  percent  confidence  level.  It  should  be  pointed  out,  however,  that  all  conclusions  con- 
tained in  this  report  are  based  on  the  data  obtained  during  the  NDI  Reliability  program  which 
used  the  NDI  techniques  and  equipment  currently  available  at  the  Air  Force  installations 
visited . 

The  state-of-the-art  is  constantly  changing  in  NDI  technology.  Inspection  reliability  im- 
provements resulting  from  recent  refinements  in  NDI  methods,  presently  undergoing  service 
evaluation  were  not  included  in  this  study.  There  was  a limited  opportunity  to  evaluate  the 
effectiveness  of  semi-automatic  eddy  current  and  ultrasonic  equipment,  beginning  at  the 
thirteenth  base  visit.  Unfortunately,  due  to  the  late  incorporation  of  semi -automated  equip- 
ment into  the  program,  the  data  quantity  restricted  determination  of  a reasonable  confidence 
level  for  this  equipment,  but  the  mean  crack  detection  levels  obtained  from  using  this  type 
of  equipment  indicate  that  9C-95  percent  reliability  criteria  may  be  possible  at  crack  sizes 
considerably  smaller  than  1/2  inch. 

The  average  capability  among  both  field  and  depot  NDI  shops  is,  with  one  exception,  uni- 
form and  predictable.  This  aspect  of  uniformity  is  a strong  point  which  can  be  used  to 
advantage  if  changes  are  inco:porated  Air  Force-wide  into  the  NDI  system.  A measure  of 
the  effect  resulting  from  a change  at  a small  sample  of  locations  should  be  indicative  of 
what  would  be  found  if  the  same  measure  were  applied  to  a large  sample.  Another  strong 
point  is  the  performance  observed  at  the  one  exceptional  location.  The  distinctly  higher 
flaw  detection  success  exhibited  at  this  facility,  especially  with  eddy  current  bolt-hole  NDI, 
as  shown  in  Figures  10-14  and  10-15,  has  demonstrated  that  much  better  performance  levels 
than  those  generally  demonstrated  are  possible.  Since  all  participants  used  the  same  struc- 
ture samples,  procedures  and  types  of  equipment  which  operated  within  acceptable  perform- 
ance characteristics,  it  must  be  concluded  that  large  differences  are  attributed  to  individual 
proficiency.  This  one  facility,  the  second  depot  visited  in  the  data  acquisition  phase,  has 
conducted  NDI  operations  as  a specialty,  has  been  selective  in  obtaining  skilled  personnel 
and  has  performed  a type  of  personnel  certification  which  was  effective.  Those  attributes 
can  serve  as  a model  in  plans  for  Air  Force-wide  efforts  to  upgrade  NDI  performance. 

Outside  of  the  differences  found  between  standard  NDI  techniques  and  the  recently  intro- 
duced semi-automatic  techniques,  the  major  variation  in  inspection  results  was  found  among 
the  individual  technicians  themselves.  There  was  an  extremely  wide  variation  exhibited 
between  individual  technicians  as  evidenced  by  the  curves  plotted  for  only  the  upper  10 
percent  of  technicians  contrasted  to  the  mean  curves  for  all  technicians  which  is  illustrated 
in  Section  X . 

There  were  no  significant  differences  (excepting  the  one  depot  previously  mentioned)  found 
between  individual  installations.,  between  individual  Commands,  or  between  field  installa- 
tions and  depots.  Neither  was  there  c significant  difference  observed  between  technicians 
using  different  manufacturer's  equipment . The  primary  source  of  variance  between  the 


12-2 


individual  tecnnicians  was  in  the  human  factors  area,  which  remains  to  be  further  investi- 
gated. The  specific  variables  of  formal  education,  age,  classification  skill  level,  NDI 
experience,  and  NDI  training  were  each  analyzed  and  proved  to  have  only  minimal  influ- 
ence on  resulting  NDI  performance. 

Another  human  factors  aspect  which  has  been  observed  but  has  not  been  treated  in  this 
program  is  the  false  call  level.  There  Is  not  yet  a generally  agreed  upon  method  for 
analyzing  the  impact  of  these  false  calls  on  NDI  reliability.  The  raw  data  presented  in 
Section  V show  extremely  high  false  counts  for  some  technicians  performing  radiographic 
NDI,  for  example.  The  success  scores  for  these  individuals  are  therefore  suspect  because 
a number  of  finds  can  be  attributed  to  pure  chance.  Fortunately,  the  instances  of  extremely 
high  false  call  levels  were  not  numerous  enough  to  make  the  total  data  picture  suspect. 


SPECIFIC  CONCLUSIONS 

Percentile  Comparisons 

One  cf  the  most  significant  findings  in  the  program  is  that  there  are  considerable  differences 
in  the  NDI  proficiencies  of  individual  technicians.  Some  technicians  are  very  good  and 
some  are  very  poor  at  detecting  flaws  in  structure  and/or  interpreting  test  results.  After 
considering  the  relatively  weak  effects  of  technician  age,  skill  level,  formal  education, 

NDI  training  and  NDI  experience,  such  vast  differences  among  individuals  must  be  attributed 
to  inherent  "human  factors".  When  the  technicians  are  divided  into  performance  peicentile 
groups,  the  wide  range  in  variations  is  revealed.  A pronounced  difference  in  performance 
is  observed  in  comparison  of  the  results  of  all  technicians  with  the  results  of  the 
upper  ten  percent  of  technicians.  This  was  done  for  POD  plots  for  Samples  "E"  and  "F" 
using  eddy  current  bolt-hole  NDI  (see  Figures  10-9  and  lO-ll)  and  for  Sample  "A"  using 
ultrasonic  shear  wave  NDI  (see  Figure  10-2).  In  all  cases,  the  curves  show  that  an  improve- 
ment in  detection  reliability  of  about  0.5  (on  a scale  of  0.0  to  1 .0)  can  be  gained  if  the 
upper  ten  percentile  performers  are  used  for  the  inspection.  This  is  particularly  true  in  the 
shorter  flaw  length  region  where  the  total  (mean)  group  exhibits  very  low  probabilities  of 
detection  and  the  upper  ten  percent  group  performs  with  substantially  greater  success. 

Depot  Performance 

There  are  no  generally  distinct  contrasts  between  depot  performance  and  the  overall  means 
among  most  structure  types  and  NDI  methods,  except  for  two  cases.  As  a group,  the  depots 
performed  the  radiographic  inspections  at  a level  of  performance  below  the  overall  mean 
for  all  installations  (see  Figures  11-34  and  11-35).  Hence,  distinctly  low  radiographic 
performance  is  attributed  to  the  depots.  On  the  other  hand,  depot  performance  in  eddy 
current  bolt-hole  inspection  was  distinctly  above  the  overall  mean  (see  Figures  11-63,  11-64, 
11-75  and  11-77);  but  these  high  results  can  be  attributed  to  the  outstanding  performance 
of  one  depot,  which  pushed  the  group  results  above  the  mean.  Overall,  there  appears  to 
be  no  significant  difference  between  depot  and  field  NDI  performance. 
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Skill  Level 


Comparisons  made  with  respect  to  the  Air  Force  skill  levels  of  technicians  have  inconsistent 
results.  The  higher  skill  levels  did  not  necessarily  turn  in  the  best  performance.  Variations 
occurred  with  respect  to  NDI  method  and  structure  type.  Pronounced  improvements  with 
increasing  skill  level  - among  the  Air  Force  3,  5 and  7 skill  levels  - were  apparent  on 
structure  Sample  "E"  with  eddy  current  bolt-hole  (ECBH)  NDI  (see  Figures  11-65,  11-66, 
and  11-67).  This  trend  did  not  hold  true,  however,  for  ECBH  NDI  on  Sample  "F",  in  which 
case  the  level  5's  outperformed  the  level  7's  (see  Figures  11-78  and  11-79).  The  level  7's 
did  perform  better  than  level  5's  using  radiography  on  Sample  "B"  (see  Figures  11-36  and 
1 1-37),  but  fell  below  the  level  5's  when  using  ultrasonic  shear  wave  on  Sample  "A"  (see 
Figures  11-15  and  11-16).  Generally  speaking,  the  skill  level  impact  on  overall  performance 
appears  minimal  and  the  only  conclusion  that  can  be  drawn  from  the  data  is  that  technician 
proficiency  in  crack  detection  ability  does  not  correlate  with  Air  Force  skill  level. 

Formal  Education 


The  cases  dealing  with  no  high  school  education,  as  compared  with  those  for  all  technicians, 
show  that  absence  of  a full  high  school  education  is  not  detrimental  to  performance.  This 
observation  is  evident,  for  example,  for  eddy  current  bolt-hole  NDI  on  both  "E"  and  "F" 
structure  samples  (see  Figures  11-63,  11-68,  11-75  and  11-80). 

Age  Differences 

The  effect  of  technician  age  (i.e.,  "maturity"  and  physical  accuity)  on  NDI  performance 
was  investigated  by  analyzing  the  results  of  two  age  groups.  The  performance  of  technicians 
under  25  years  of  age  were  contrasted  with  the  performances  of  technicians  over  40  years  of 
age.  The  results  of  this  comparison  were  again  mixed.  The  older  group  performed  better 
than  the  younger  group  using  the  ultrasonic  technique  on  Sample  "A"  (see  Figures  11-17 
and  11-18),  and  the  eddy  current  bolt-hole  technique  on  Samples  "E"  and  "F"  (see  Figures 
11-69,  11-70,  11-81  and  11-82).  In  contrast,  the  younger  group  performed  more  reliably 
using  the  ultrasonic  technique  on  Sample  "F"  (see  Figures  11-92  and  11-93)  and  the  radio- 
graphic  technique  on  Sample  "B"  (see  Figure  11-38).  Since  there  is  no  apparent  reason  to 
assign  age  attributes  to  the  program  samples  or  to  the  techniques,  the  results  provide  no 
basis  for  predicting  performance  based  on  age. 

Years  of  NDI  Experience 

As  with  age,  two  experience  groups  were  compared.  The  performance  of  technicians  having 
less  than  three  years  NDI  experience  was  compared  with  the  performance  of  technicians 
having  more  than  ten  years  experience . Since  the  duration  of  experience  is  loosely  related 
to  age,  it  is  not  possible  to  entirely  isolate  the  effects  of  these  separate  variables.  Never- 
theless, a comparison  of  the  two  experience  groups  showed  no  substantia!  difference  in 
performance.  Only  on  the  plots  for  Samples  "E"  and  "F"  for  eddy  current  bolt-hole  NDI 
(see  Figures  1 1-72,  1 1-73,  1 1-83  and  1 1-84)  was  there  significant  differences  for  the 
experience  evaluations,  and  these  differences  occurred  only  in  the  extrapolated  regions  of 
the  plots.  The  point  estimates  are  very  similar.  Hence,  no  generally  predictable  trend  was 
evident  in  the  comparisons  for  length  of  NDI  experience. 
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NDI  Training 

The  hours  of  formal  ND!  training,  as  reported  by  the  technicians,  were  examined  for  effect 
on  performance  by  contrasting  those  with  under  200  hours  to  those  having  over  500  hours. 
There  is  some  indication  that  an  inverse  relationship  exists,  i.e.,  those  with  more  formal 
training  do  not  perform  as  well  as  those  with  less.  This  does  not  mean  that  additional 
training  would  degrade  performance,  but  it  does  indicate  that  additional  formal  training  of 
the  type  reported  would  not  automatically  yield  improved  proficiency.  For  example,  a 
pronounced  inverse  relation  between  performance  and  training  level  appears  in  the  case  of 
ultraronic  shear  wave  NDI  on  Sample  "A"  (see  Figures  i 1 —20  and  11-21),  yet  the  opposite 
result  appear:  lor  ultrasonic  shear  wave  NDI  on  Sample  "C"  (see  Figures  11-61  and  11-62). 
These  contradictory  examples  indicate  that  one  or  more  additional  variables  have  influenced 
the  results  and  that  further  analyses  will  be  necessary  to  gain  a clear  picture  of  NDI  training 
effects. 


RECOMMENDATIONS 


Near-Term  NDI  Reliability  Improvements 

The  primary  source  of  the  variance  in  the  data  collected  and  the  main  cause  of  failure  to 
detect  flaws  is  attributed  to  the  human  factor  element  in  the  NDI  process.  There  is  a need 
to  concentrate  on  a practical  method  to  evaluate  the  proficiency  of  the  NDI  technician  as 
well  as  an  increased  evaluation,  skill  development  and  motivation  of  the  NDI  technician. 
Practical  NDI  examinations  should  be  periodically  administered  to  technicians  and  their 
performance  ratings  made  available  to  them.  Opportunities  for  periodic  re-examination 
and  flaw  detection  practice  on  hardware  would  be  highly  desirable.  Mandatory  review  of 
ratings  by  supervision  and  management  would  provide  avenues  for  positive  motivation. 

Other  sources  of  motivation  can  be  implemented  on  a near-term  basis.  For  example,  the 
NDI  decals  distributed  during  the  field  data  collection  part  of  the  program  were  of  signi- 
ficant interest  to  the  NDI  technicians.  Many  expressed  a desire  to  have  a uniform  patch 
similar  to  the  decal . Therefore,  Air  Force  approval  for  the  use  of  such  a uniform  patch  by 
military  NDI  personnel  should  be  sought. 

Proficiency  Determinations 

The  commonly  assumed  indicators  of  NDI  proficiency  such  as  technician  skill  level,  years 
of  experience,  maturity  in  terms  of  age,  extent  of  formal  education,  and  hours  of  formal 
NDI  training  do  not  provide  a true  indication  of  flaw  detection  proficiency.  True  profi- 
ciency of  a technician  must  be  evaluated  by  methods  which  have  a proven  and  consistent 
relationship  with  actual  flaw  detection  capabilities.  Practical  examinations,  administered 
with  actual  flaws  in  hardware,  should  be  developed  for  such  proficiency  determinations. 
Standards  of  performance  need  to  be  established  with  the  norms  set  to  attainable  goals 
defined  from  experience . 
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Certification 


Presently,  the  formal  NDI  training  to  attain  a skill  level  is  performed  at  Chanute  Air  Force 
Base,  where  the  technician  attends  a course  for  the  level  sought.  The  individual  then 
remains  at  that  level  until,  through  experience  and  study,  he  or  she  is  qualified  to  attend 
the  training  course  for  the  next  higher  level . 

NDI  personnel  at  the  Logistics  Centers  are  trained  in  NDI  in  accordance  with  the  require- 
ments established  at  each  of  the  five  centers.  In  some  Logistics  Centers,  NDI  is  a part-time 
activity  and  not  the  primary  job,  while  in  other  centers  it  is  a full-time  job.  It  is  recom- 
mended that  the  Logistics  Centers  centralize  NDI  activities  and  make  NDI  a full-time 
certified  occupation  where  this  is  not  already  established. 

It  is  also  recommended  that  a standard  certification-recertification  program  be  established 
through  the  administration  of  practical  examinations  at  all  bases  and  depots.  Kits  or 
certification  packages,  composed  of  hardware  with  cataloged  flaws,  detailed  NDI  proce- 
dures and  complete  instructions  for  the  test  administration,  could  be  developed.  A certifi- 
cation body  would  manage  the  scheduling,  grading  and  reporting  functions,  but  each  base 
or  depot  could  implement  the  testing.  A routine  would  also  have  to  be  established  to 
reassign  noncertifiable  personnel. 

Training 

Formal  training  programs  vary  in  content  and  quality  in  part  due  to  personnel  changes,  vari- 
able funding,  changes  in  instruction  courses,  and  variations  in  the  use  of  training  aids. 
Informal  training  (on-the-job  training)  suffers  an  even  wider  range  of  variation  in  quality. 

A comprehensive  evaluation  of  all  training  functions  for  NDI  should  be  considered.  Of 
particular  importance,  the  Chanute  Air  Force  Base  NDI  course  should  be  given  first  atten- 
tion. To  this  end,  it  is  recommended  that  a Training  Review  Committee  be  established  to 
evalucte  that  training  facility.  This  committee  should  include  persons  knowledgable  in 
education,  human  factors,  psychology,  as  well  as  current  and  future  AF  NDI  requirements. 
This  group  should  conduct  evaluations  of  the  content  of  the  overall  training  program  and 
the  methods  used  for  its  delivery;  plus  evaluations  of  Chanute  Air  Force  Base  NDI  training 
personnel,  equipment,  training  facilities  and  training  aids.  When  these  evaluations  are 
done,  a complete  report  of  findings  with  recommendations  should  be  made  by  the  Committee 
to  the  Air  Force  Training  Command  for  review  and  implementation. 

Logistics  Center  NDI  Training:  The  training  of  NDI  personnel  at  the  Air  Force  Logistics 
Centers  is  a local  in-house  operation,  supplemented  by  commercial  courses  such  as 
Magnaflux,  General  Dynamics,  and  Eastman  Kodak.  All  NDI  personnel  of  the  Logistics 
Centers  are  civilian  employees  and  personnel  turnover  is  much  lower  than  at  military  field 
installations;  therefore,  no  separate  full  time  training  facility  is  justified. 

Personnel  Screening  Program:  It  is  recommended  that  a study  be  conducted  to  develop  a 
personnel  screening  program  forselection  of  NDI  personnel.  The  intent  of  this  program 
would  be  to  identify  those  candidates  who  are  compatible  with  the  occupation  and  to 
eliminate  from  the  NDI  career  field,  those  persons  not  suited  by  intelligence,  tempeiament, 
or  dexterity  for  NDI  type  work. 
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The  screening  program,  during  its  development,  could  be  evaluated  by  first  testing  a group 
of  NDI  technicians  to  determine  their  relative  inspection  abilities,  and  then  subjecting 
these  technicians  to  the  screening  program  to  determine  if  the  program  correctly  differentiates 
between  the  good  and  bad  inspectors.  After  the  program  is  found  to  be  suitably  accurate, 
its  successful  completion  by  potential  NDI  technicians  should  be  established  as  a requirement 
for  entry  into  NDI  training.  For  a period  of  time,  personnel  who  entered  the  NDI  field  via 
this  route  should  be  evaluated  to  determine  If  they  do  indeed  turn  out  to  be  proficient  inspec- 
tion personnel . 

On-the-Job-Training:  The  final  training  recommendation  concerns  on-the-job  training  (OJT). 
It  is  recommended  that  a standardized  OJT  program  be  developed  and  instituted  Air  Force 
wide.  Standard  training  kits  with  training  manual  should  be  developed  and  distributed  to 
each  Air  Force  Bcse . These  kits  would  Include  actual  fatigue  cracked  structure  typical  of 
that  to  be  found  in  service  (at  present  there  are  none  available  for  this  purpose).  These 
specimens  should  contain  a spectrum  of  flaw  sizes  and  should  include  structure  to  be  inspected 
by  ultrasonics,  eddy  current,  surface  probe,  eddy  current  bolt-hole  probe,  penetrant,  x-ray, 
end  magnetic  particle. 

Equipment 

The  state-of-the-art  equipment  used  in  both  the  pre-data  acquisition  trials  and  in  the  data 
acquisition  itself,  was  inherently  capable  of  response  to  the  majority  of  flaws  in  the  structure 
samples.  In  some  cases,  however;  notably  on  Sample  "F"  with  ultrasonic  NDI,  it  was  not 
possible  to  routinely  obtain  responses  from  all  the  flaws.  The  question  then  remains:  why  is 
a flaw  missed  if  the  process  is  capable  of  detection?  One  important  answer  is:  the  equip- 
ment and/or  process  does  not  sufficiently  alert  the  operator  when  a flaw  response  is  present. 
There  are  potential  solutions  to  this  problem  within  the  realm  of  equipment  design  improve- 
ments. Several  of  these  are  to:  (a)  improve  the  signal-to-noise  ratio  i.i  both  detection  and 
readout  functions,  (b)  promote  operator  vigilence  through  enhanced  stimuli  to  sensual 
perception,  (c)  channel  the  operator's  attention  to  flaw  indications,  (d)  provide  positive 
assurances  that  the  equipment  is  performing  its  intended  functions,  and  (e)  automatically 
program  and  control  those  functions  which  are  susceptible  to  human  error. 

Each  of  these  potential  equipment  improvements  i*.  within  the  scope  of  today's  technology. 
Programs  to  develop  improved  versions  of  NDI  equipment  and  processes  should  include 
guidance  from  the  technician/user,  including  engineering  specialists  and  the  personnel 
responsible  for  the  day-to-day  NDI  operations.  Full  advantage  should  be  taken  from  the 
advent  of  microprocessors  and  newly  emerging  electronic  devices  which  provide  a number  of 
powerful,  complex  operations  for  signal  processing,  instrument  readout  and  process  control. 

In  all  cases,  any  "improved"  version  of  equipment  should  demonstrate  its  flaw  detection 
reliability  under  realistic  conditions.  Improved  resolution,  sensitivity  and  flaw  character- 
ization features  do  not  automatically  imply  superior  flaw  detection  reliability.  The  process 
of  detection  is  uniquely  different  from  the  interrogation  of  the  flaw  itself.  In  some  cases, 
the  function  of  flaw  searching  should  be  separated  from  the  activity  of  flaw  interrogation. 
Therefore,  different  equipment  designs  or  approaches  may  be  necessary  to  optimize  each. 
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Interdisciplinary  Analyses 

Information  that  has  been  derived  from  this  program  is  applicable  to  planning  inspection 
intervals,  optimizing  NDI  operations  and  the  formulation  of  structural  failure  risk  analyses. 
A number  of  NDI  options  should  be  explored  through  various  treatments  of  the  raw  data 
stored  by  computer  as  described  in  Section  VIII,  Data  Storage  and  Retrieval.  Various  com- 
binations of  redundant  NDI  with  the  same  method  and  mixes  of  different  methods  should  be 
examined  for  cumulative  detection  probabilities.  The  known  detection  levels  for  given  flaw 
sizes  should  be  integrated  into  fracture  and  fatigue  models  to  exercise  inspection  interval 
options.  Comprehensive  structural  risk  analyses  are  also  possible  with  a knowledge  of  flaw 
detectability.  Information  concerning  initial  flaw  size  distributions  in  new  structure,  flaw 
growth  rates  and  detection  probabilities  provides  a basis  for  predicting  failure  probabilities 
under  service  conditions.  Heretofore,  risk  analyses  employed  only  assumptions  for  in- 
service  flaw  detectability.  With  the  data  now  available  from  this  program,  these  risk 
analyses  should  be  updated  for  more  accurate  predictions. 

Workshop  Findings 


A number  of  recommendations  concerning  NDI  reliability  improvements  have  been  made  by 
the  eight  Task  Groups  who  reviewed  data  from  this  program  at  a Government/industry 
Workshop  on  NDI  Reliability  held  in  Houston,  Texas,  2-4  August  1978.  The  complete 
report  on  this  activity  Is  provided  in  the  publication  entitled  "Workshop  Proceedings  - 
Government/industry  Workshop  on  NDI  Reliability,"  Report  No.  SA-ALC/MME  76-6-38-2 . 
The  major  problem  areas  which  were  addressed  are  os  follows: 


1. 

Personnel 

5. 

2. 

Training 

6. 

3. 

Certification 

7. 

4. 

Operations  (Management) 

8. 

Equipment 

Reliability  Measurement/Modeling 
Fracture  Mechanics/NDE 
Interrelationships 
Data  Analysis 


A 


summary  of  Workshop  recommendations  for 


each  problem  area  is  provided  below; 


Personnel 


Individuals  should  be  selected  on  the  basis  of  identified  traits  which  are  necessary 
for  high  proficiency  and  motivation.  Rewards  and  information  feedback  provisions 
should  be  implemented  to  promote  excellence. 

Training 

Classroom  and  practical  training  aimed  at  multiskilled  NDI  capabilities  should  be 
conducted  in  two  phases  of  professional  development.  The  first  phase  should  have 
45  percent  class  time  and  55  percent  practical  "hands-on"  instruction.  The  second 
phase  should  have  35  percent  class  time  and  65  percent  "hands-on"  . Both  training 
phases  should  be  conducted  at  a centralized  facility  for  uniformity. 
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Certification 


A formal  certification  of  personnel  by  examination,  which  consists  of  both  written 
and  practical  segments  would,  without  question,  improve  reliability.  It  should 
definitely  be  required  of  all  personnel  who  perform  NDI  on  aircraft  or  aircraft 
components . 

Operations  (Management) 


NDI  should  organizational ly  report  directly  to  the  chief  of  maintenance  and  personnel 
should  be  assigned  to  full  time  NDI . Depots  should  be  given  the  authority  to  monitor 
field  operations,  provide  well  defined  NDI  procedures  as  Technical  Orders,  assure 
the  availability  of  proper  equipment  for  field  use  and  piovide  training  assistance  to  the 
field . 

Equ ipment 


Improvements  in  equipment  should  be  sought  through  automation  and  the  use  of  digital 
processors  tor  control  and  data  treatment.  Permanent  records  and  visual  displays  are 
desirable  and  necessary  adjuncts  to  maintaining  vigilence  in  detection.  Combined 
flaw  search  and  characterization  attributes  would  be  good  to  have  in  a single  instru- 
ment . 

Reliability  Measurement/Modeling 

The  "windows"  for  new  studies  deal  with  the  signal-to-noise  considerations  in,  human 
factors,  equipment,  and  validation  of  models.  Attention  should  be  given  to  the  man,/ 
machine  interface,  the  physical/mental  attributes,  equipment  output  stimulus  level 
and  patterns  and  modeling  transfer  functions  to  account  for  test  object  shape. 

Fracture  Meehan ics/NDI  Interrelationships 


The  trade-offs  between  frequency  of  inspection  and  redundant  NDI  applications  should 
be  examined  for  their  impact  on  reliability.  Technical  Order  NDI  procedures  tailored 
to  fracture  critical  parts  should  be  developed  for  any  new  aircraft  or  majoi  assembly. 
Risk  analysis  which  uses  NDI  reliability  date  should  be  examined. 

Data  Analysis 


Further  examination  of  existing  data  should  be  made  before  any  additional  dofo  are 
acquired.  New  programs  should  define  the  questions  the  data  are  to  answer,  define 
the  analysis  model,  define  ihe  experiment  to  elucidate  cause  and  effect  and  the  data 
should  be  amenable  to  different  analysis  methods. 
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SELF  INTRODUCTION  FDR  AUTOMATED  EDDY  CURRENT 
SCANNING  SYSTEM 


NOTE 

The  following  instructions  are  to  be  used  for  training 
personnel  in  the  use  of  the  Gulton  FD-100  Automatic 
Eddy  Current  Scanning  System.  Any  questions  concerning 
instrument  settings,  calibration,  operation  or  interpre- 
tation should  be  directed  to  the  attending  Lockheed  Georgia 
Company  Engineer. 


Equipment: 

(1)  Crack  Detector,  Gulton  FD-100 

Automatic  Eddy  Current  Scanning  System  (figure  i) 

(2)  Probe,  Bolt  Hole,  3/16-inch,  1/4-inch,  and  5/16-inch,  diameter  P/N  L 1027*18-1, 
-3,  -5,  or  equivalent 

(3)  Calibration  Standards  SS-1  and  CW-1  (See  figure  2.) 

(4)  Practice  Specimens  SSB-1  (figure  3)  and  CWB-1  (figure  4) 

Access:  The  fasteners  have  been  removed  from  holes  that  are  to  be  used  in  this 

program. 

Preparation  of  Part:  The  holes  have  been  cleaned;  therefore,  no  additional  clean- 
ing should  be  required.  However,  after  repeated  inspections  the 
accumulations  from  probe  wear  deposits  should  be  removed  with  solvent  and 
a brush. 

Instrument  Setting/Calibration:  The  following  general  instrument  set  up  and  cali- 
bration instructions  are  to  be  used  for  training  purposes  using  the  Gulton 
automated  eddy  current  scanning  system  and  the  practice  specimens  SSB-1 
and  CWB-1. 

(1)  Open  the  FD-100  instrument  case  and  remove  all  cables  and  the  scanner  head 
from  the  storage  compartment. 

(2)  Connect  the  scanner  head  cable  to  the  MOTOR  connector  on  the  FS-100  instru- 
ment. 

(3)  Connect  the  scanner  head  RF  signal  cable  to  the  SIGNAL  connector  on  the  FD-100 
instrument. 
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(^)  Connect  the  three  (3)  wire  power  cable  to  the  FD-100  and  plug  into  a 60  Hz  115 
VAC  grounded  outlet. 

wmrRg 

The  FD-100  system  uses  a safety  grounded,  three  (3)  wire  AC 
power  input.  DO  NOT  ATTEMPT  TO  CHEAT  OR  DEFEAT  THE  BUILT-IN 
SAFETY  GROUND.  In  the  event  that  a properly  grounded  1.1.5  VAC, 

6C  Hz  three  (3)  prong  source  is  not  available,  use  an  un- 
grounded two  (2)  wire  and  a three  (3)  wire  to  two  (2)  wire 
adapter  with  built-in  grounding  pigtail.  Ensure  that  the 
pigtail  is  properly  connected  to  a good  external  ground 
base  or  preferably,  to  an  earth  ground. 

(5)  Place  power  switch  to  ON;  allow  the  equipment  to  warm  up  for  10  minutes,  and 
set  MODE  SELECTOR  switch  on  the  ED-520  to  ”L0"  position. 

(6)  Select  one  of  the  eddy  current  probes. 

(7)  Insert  the  probe  into  the  scanner  head  as  follows:  Locate  the  "T"  shaped 

groove  on  the  connector  end  of  the  probe.  Line  up  the  "T"  on  the  probe  with 

the  index  mark  on  the  top  surface  of  the  scanner  head  gear  and  plug  in  the 
probe.  Turn  the  probe  clockwise  to  lock  it  in  position. 

(8)  Place  the  SCANNER  RPM  adjust  knob  to  about  75  RPM. 

(9)  Place  the  switch  on  the  scanner  head  in  the  EXTEND  position  and  note  that  the 

probe  will  rotate  out  of  the  head,  extending  the  probe.  The  probe  will 
continue  to  extend  until  it  reaches  the  limit  denoted  on  the  thumbwheel  LIMIT 
SWITCH  index  mark. 

CAUTION 

Do  not  adjust  the  thumbwheel  limit  switch  unless  the  probe 
is  retracted  fully  in  the  RETRACT  position  and  has  stopped 
automatically  against  the  bottom  stop.  Failure  to  comply 
could  damage  the  drive  mechanism  and  require  disassembly  in 
order  to  make  repairs. 

( 10)  Place  the  scanner  switch  in  the  RETRACT  position  to  rotate  the  probe  into  the 
scanner  head.  Continue  retracting  the  probe  until  it  has  automatically 
stopped  against  the  bottom  stop,  i.e. , in  the  fully  retracted  position. 

(11)  The  difference  in  probe  length  between  the  fully  extended  and  the  fully 
retracted  positions  is  the  amount  of  probe  travel  as  denoted  on  the  LIMIT 
SWITCH.  The  LIMIT  SWITCH  is  adjustable  from  zero  (0)  to  approximately  1-1/2 
inches.  Determine  the  total  thickness  of  material  (standard  or  practice 
sample)  which  is  to  be  inspected  and  adjust  the  LIMIT  SWITCH  to  the  appro- 
priate setting  while  it  remains  in  the  fully  retracted  position. 

(12)  Place  the  SCANNER  RPM  adjust  knob  in  other  positions  and  repeat  steps  (9)  and 
(10)  to  note  range  of  scanner  speeds  available  with  the  system. 
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Calibration  of  System/ ED-520: 

(1)  Set  the  equipment  up  as  directed  in  previous  paragraphs. 

(2)  Set  the  MODE  SELECTOR  switch  to  ML0"  position. 

(3)  Set  the  SENSITIVITY  control  to  a mid-range  position. 

(4)  Set  the  LIFT-OFF /FREQ  control  1/2  revolution  clockwise  from  zero  at 
• approximately  0050. 

(5)  Place  a 0.007  inch  thick  piece  of  masking  tape  on  one  of  the  supplied 
standards. 

NOTE 

When  calibration  is  done  on  the  supplied  standard,  en- 
sure that  a location  which  is  free  of  paint  is  used. 

(6)  Place  the  probe  on  the  standard  used  for  calibration. 

(7)  Bring  the  needle  on  scale  with  the  BALANCE  control.  If  unable  to  bring  the 
needle  back  on  scale  with  the  BALANCE  control,  advance  the  LIFT-OFF /FREQ 
control  clockwise  until  the  needle  comes  on  scale. 

(8)  Adjust  the  LIFT-OFF /FREQ  control  clockwise  until  the  first  null  point  is 
located,  using  the  BALANCE  control  to  keep  the  needle  on  scale.  The  required 
null  point  is  recognized  when  the  needle,  swinging  up  scale,  stops  and 
reverses  direction  as  the  LIFT-OFF /FREQ  control  is  rotated  in  a constant  clock- 
wise direction.  If  the  needle  cannot  be  kept  on  scale  with  the  BALANCE  con- 
trol continue  to  rotate  the  LIFT-OFF /FREQ  control  until  the  needle  returns  to 
scale. 

(9)  After  the  null  point  is  reached,  turn  the  LIFT-OFF/FRBQ  control  counterclock- 

wise a small  amount  to  stay  on  the  front  side  of  the  null.  Move  the  probe  on 
to  the  tape  and  note  direction  of  the  needle  deflection.  The  needle  should 
deflect  up  scale.  If  the  needle  deflects  up  scale,  increase  the  frequency  a 
small  amount  by  turning  the  LIFT-OFF/FREQ  control  counterclockwise.  Continue 
moving  the  probe  from  metal  to  tape  and  adjusting  the  two  controls  until  there 

is  a maximum  deflection  of  only  one  (1)  minor  division  up  scale.  If  the 

needle  deflects  down  scale  when  the  probe  is  moved  from  metal  to  tape,  de- 
crease the  frequency  by  turning  the  LIFT-OFF/FREQ  control  a small  amount  clock- 

wise. Continue  to  move  the  probe  from  metal  to  tape  and  adjusting  the  con- 
trols until  there  is  a maximum  deflection  of  only  one  (1)  minor  division  up 
scale. 

(10)  Lock  the  LIFT-OFF/FREQ  control. 

NOTE 

On  most  probes,  the  final  calibration  frequency  will 
be  between  0050  and  0150  on  the  control  dial. 

(11)  With  the  probe  in  the  fully  retracted  position  (against  the  bottom  stop)  and 

. the  LIMIT  SWITCH  set  for  an  appropriate  probe  travel,  insert  the  probe  into  a 
hole  that  is  to  be  inspected.  • 
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(12)  Adjust  the  BALANCE  control  for  10  percent  of  full  scale  reading. 

(13)  Index  the  probe  into  approximately  the  middle  of  the  thickest  layer  of 
material  to  be  inspected. 

(14)  Adjust  the  sensitivity  control  for  90  percent  of  full  scale  reading. 

(15)  Repeat  until  10  percent  and  90  percent  readings  are  obtained. 

Recorder  Set-Up  and  Faiiiiliarity: 

(1)  Turn  the  OFF-ON-AUTO  switch  to  the  AUTO  position  so  that  the  recorder  and 
scanner  will  start  or  stop  at  the  same  time. 

(2) .  Place  the  recorder  SLOW/FAST  switch  in  the  SLOW  position  and  the  FILTER  switch 

in  the  50  RPM  position. 

(3)  Depress  the  scanner  head  RETRACT /EXTEND  switch  to  the  EXTEND  position.  Using 
a Scanner  RPM  of  75  or  less,  observe  the  recording  trace  on  the  tape  readout 
as  the  probe  extends.  If  the  trace  is  too  light  or  too  dark,  adjust  the  HEAT 
control  to  obtain  a desirable  trace  contrast  and  width  (about  mid  range  of  con- 
trol). Now  adjust  the  ZERO  control  to  bring  the  trace  to  the  centerline  of 
the  tape. 

(4)  Fully  retract  the  probe  using  the  scanner  head  switch. 

(5)  Select  one  of  the  standards,  either  SS-1  or  CW-1,  and  set  the  scanner  head 
LIMIT  SWITCH  for  full  hole-depth  probe  travel. 

(6)  Insert  the  probe  into  the  hole  of  the  standard  containing  the  simulated  defect 
and  depress  the  scanner  head  RETRACT/EXTEND  switch  to  the  EXTEND  position. 

The  recorder  tape  feed  and  probe  rotation  will  begin  simultaneously. 

(7)  Scan  the  entire  hole  surface  until  the  probe  reaches  its  travel  limit,  at 
which  point  the  probe  and  tape  motion  will  cease. 

(8)  Observe  the  tape  trace  of  the  simulated  defect  and  determine  whether  the 
maximum  trace  excursion  is  about  80  percent  of  the  distance  from  the  tape 
centerline  to  the  edge  of  the  grid.  If  it  is  not,  depress  the  scanner  head 
RETRACT/EXTEND  switch  to  the  RETRACT  position  until  the  probe  position  in  the 
hole  coincides  with  the  maximum  defect  trace  excursion.  When  this  point  is 
reached,  quickly  turn  the  scanner  switch  to  OFF. 

NOTE 

The  trace  pattern  will  new  be  reversed  relative  to  the 
pattern  obtained  in  step  7,  since  the  probe  travel 
direction  is  now  reversed. 

(9)  Adjust  the  recorder  GAIN  to  obtain  the  80  percent  defect  trace  excursion. 

Then  depress  the  scanner  head  switch  to  the  RETRACT  position  to  continue 
retracting  the  probe. 

(10)  Repeat  steps  (7),  (8),  and  (9)  and  adjust  recorder  GAIN,  HEAT,  or  ZERO  control 
as  necessary  to  improve  the  trace. 
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(11)  Retrace  the  hole  several  times  and  vary,  alternately,  the  recorder  FAST/SLOW, 
SCANNER  RPM,  and  the  FILTER  controls  to  study  their  effects  on  defect  trace 
resolution  and  quality  and  for  familiarization. 

NOTE 

The  FD-100  system  is  now  calibrated  and  set-up  for 
practice  inspections.  The  trainee  may  repeat  any  or 
all  portions  of  these  procedures  until  he  is  satisfied 
with  his  familiarity  with  the  equipment  operation. 


Practice  Inspection: 

(1)  Set  the  FD-100  controls  as  follows: 

a.  CHART  SPEED  FAST /SLOW  switch  to 

SLOW 

b. 

MODE  SELECTOR  switch  to 

LO 

c. 

Recorder  GAIN  control  to 

MAX 

d. 

SCANNER  RPM  to 

75  RPM 

e. 

CHART  OFF-ON-AUTO  switch  to 

AUTO 

f. 

FILTER  switch  to 

50  RPM 

g. 

Scanner  head  switch  positions 
(for  reference  only) 

CENTER  POSITION 

EXTEND  POSITION 

RETRACT  POSITION 

PROBE  OFF 

PROBE  INTO  HOLE 

PROBE  OUT  OF  HOLE 

NOTE 

The  recorder  GAIN  can  be  adjusted  as  necessary  to 
obtain  a satisfactory  signal-to-noise  relationship 
at  any  hole  inspected.  If  a defect  trace  overruns 
the  tape  edge,  the  GAIN  should  be  reduced. 

(2)  Fully  retract  the  probe  and  set  the  scanner  head  LIMIT  SWITCH  for  appropriate 
probe  travel  for  inspecting  the  open  fastener  holes  in  one  of  the  practice 
specimens  as  selected. 

(3)  Insert  the  probe  tip  into  the  first  hole  to  be  inspected  and  inspect  the 
entire  surface  of  each  hole.  Place  the  scanner  RETRACT /EXTEND  switch  to  the 
EXTEND  position  to  move  the  probe  into  the  hole.  The  recorder  and  scanner 
will  start  at  the  same  time  and  will  stop  when  the  preset  probe  travel  limit 
is  reached. 


(4)  Observe  the  tape  readouts  and  meter  deflections  as  the  probe  moves  through  the 
hole.  The  meter  needle  should  move  up  scale,  down  scale,  up  scale  and  then 
down  scale  as  the  probe  travels  from  an  edge  towards  the  center  of  one  layer 
on  towards  the  interface  and  again  towards  the  center  of  the  second  layer  and 
then  towards  the  last  edge.  The  slow  signal  change  resulting  in  a slow  needle 
movement  does  not  cause  a change  to  the  recorder  because  slow  changes  are 
filtered.  Rapid  signal  changes  may  be  superimposed  on  the  edge  and  interface 
signals;  these  will  shew  as  indications  on  the  recorder  and  as  rapid  de- 
flections by  the  meter  needle.  Lift-off  is  usually  shown  by  a recording 
indication  which  is  180  degrees  out  of  phase  with  a crack  indication.  A crack 
indication  starts  in  a negative  direction,  swings  positive,  and  then  negative. 
Lift-off  starts  in  a positive  direction,  goes  negative,  and  then  positive. 

(5)  There  is  no  need  to  retract  the  probe  into  the  scanner  to  inspect  the  next 
hole.  Simply  remove  the  probe  from  the  first  hole  and  insert  it  fully  into 
the  second.  Depress  the  scanner  RETRACT/EXTEND  switch  to  the  RETRACT  position 
and  scan  the  hole  surface  as  the  probe  is  retracted.  This  recorder  trace  will 
be  reversed  in  direction  from  the  trace  for  the  first  hole. 

(6)  Continue  inspecting  the  open  fastener  holes  in  the  two  practice  specimens  as 
instructed. 

NOTE 

If  the  defect  indication  on  the  recorder  from  a specific 
hole  goes  off-scale,  or  too  much  noise  is  observed,  de- 
crease the  recorder  GAIN. 

The  charts  in  figure  5 show  tape  read-out  examples  taken  from  the  test  panels 
that  will  be  used  for  training. 

NOTE 

The  shorter  readout  is  produced  with  the  recorder  SLOW/ 

FAST  switch  in  the  SLOW  position;  the  longer  one  is  pro- 
duced with  the  switch  in  the  FAST  position. 

The  diagrams  in  figures  3 and  4 key  the  tape  examples  to  specific  holes  in  the 
test  panels. 


A -7 


CENTER  WING  STANDARD 


TYPICAL  RECORDING  READOUT  SHOWING  DEFECT 
TAPE  NO.  I.  THIS  SHOWS  THE  ELOX  SLOT  THROUGH  BOTH  LAYERS. 


Figure  2.  Calibration  Standards  for  use  with  the  Automated  Eddy  Current  Scanning 
System  Self  Instruction  Practice 


TAPE  NO.  2.  SCAN  OF  HOLE  NO.  8.  THIS  SHOWS  ONE  DEFECT  AT  THE  INTERFACE  WITH  MINIMUM  NOISE 


Fteure  5.  Gulton  System  Typical  Tape  Hoadouts  (Sheet  1 of  11) 
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TAPE  NO.  3.  SCAN  OF  HOLE  NO.  12.  THIS  SHOWS  ONE  DEFECT  AT  THE  INTERFACE.  NOTE  THAT  IT  IS 
SMALLER  THAN  THAT  SHOWN  IN  TAPE  4. 


TAPE  NO.  4.  SCAN  OF  HOLE  NO.  4.  THIS  SHOWS  TWO  DEFECTS  ON  ONE  SIDE  OF  THE  INTERFACE.  NOTE 
THAT  ONE  DEFECT  IS  SMALLER  THAN  THE  OTHER  AND  AT  AN  ANGLE  OF  APPROXIMATELY 
180  DEGREES  FROM  IT. 


Figure  5.  Gulton  System  Typical  Tape  Readouts  (Sheet  2 of  11) 
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SCAN  OF  HOLE  NO.  16.  THIS  SHOWS  TWO  CRACKS,  ONE  ON  EACH  SIDE  OF  THE  INTERFACE 
AT  AN  ANGLE  OF  APPROXIMATELY  180  DEGREES  TROM  EACH  OTHER. 
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SCAN  OF  HOLE  NO.  17.  THIS  SHOWS  TWO  CRACKS  ON  THE  SAME  SIDE  OF  THE  INTERFACE 
AT  AN  ANGLE  OF  APPROXIMATELY  180  DEGREES  FROM  EACH  OTHER. 


Figure  5.  Gulton  System  Typical  Tape  Readouts  (Sheet  4 of  11) 
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TAPE  NO.  <?.  SCAN  Oh  HOLE  NO.  59.  ALTHOUGH  THIS  HOLE  PRODUCED  A LOT  OF  NOISE,  A CRACK  CAN 
BE  DETECTED  IN  ONE  SIDE  OF  THE  INTERFACE. 
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TAPE  NO  1C  SCAN  OF  HOLE  NO.  23.  THIS  SHOWS  THREE  DEFECTS.  TWO  DEFECTS  ARE  ON  ONE  SIDE  OF 

THE  INTERFACE  AT  AN  ANGLE  OF  180  DEGREES  FROM  EACH  OTHER,  THE  THIRD  IS  A CRACK  ON 
THE  OTHER  SIDE  OF  THE  INTERFACE.  NOISE  SHOWS  THROUGHOUT  THE  HOLE. 


Figure  5.  Gulton  System  Typical  Tape  Readouts  (Sheet  5 of  11) 


TAPE  NO.' 12.  SCAN  OF  HOLE  NO.  46.  THIS  SHOWS  A SMALL  CRACK  ON  ONE  SIDE  OF  THE  INTERFACE. 


Figure  5.  Gulton  System  Typical  Tape  Hendouts  (Sheet  0 of  11) 
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TAPE  NO.  14.  SCAN  OP  HOLE  NO.  56.  THIS  SHOWS  TWO  CRACKS  ON  THE  SAME  SIDE  OF  THE  INTERFACE  AT 
AN  ANGLE  OF  APPROXIMATELY  180  DEGREES  FROM  EACH  OTHER. 


Figure  5.  Gulton  System  Typical  Ta(>o  Readouts  (Sheet  7 of  11) 


TAPE  NO.  15.  SCAN  OF  HOLE  NO.  57.  THIS  SHOWS  A LARGE  CRACK  ON  ONE  SIDE  OF  THE  INTERFACE. 
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TAPE  NO.  16.  SCAN  OF  HOLE  NO.  61.  THIS  SHOWS  TWO  DEFECTS  ON  THE  SAME  SIDE  OF  THE  INTERFACE 
AT  AN  ANGLE  OF  APPROXIMATELY  120  DEGREES  FROM  EACH  OTHER. 


Figure  5.  Gulton  System  Tvpicnl  law  Readouts  (Sheet  8 of  11) 
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SCAN  OF  HOLE  NO.  63.  THIS  SHOWS  A LARGE  CRACK  EXTENDING  THROUGH  ONE  LAVER 
OF  MATERIAL. 


. SCAN  OF  HOLE  NO.  65.  THIS  SHOWS  A SMALL  CRACK  ON  ONE  SIDE  OF  THE  INTERFACE. 


Figure  5.  Gulton  System  Typical  Tape  Readouts  (Sheet  t>  of  11) 


TAPE  NO.  20.  SCAN  OF  HOLE  NO.  2.  THIS  SHOWS  TYPICAL  NOISE  FROM  A HOLE.  NO  DEFECTS  WERE 
DETECTED. 


TAPE  NO,  71.  SCAN  OF  HOLE  NO.  20.  THIS  SHOWS  EXCESSIVE  NOISE  FROM  A HOLE.  NO  DCFECTS  WERE 
DETECTED. 


TAPE  NO.  22.  SCAN  OF  HOLE  NO.  A39.  THIS  SHOWS  A TYPICAL  SMALL  DEFECT  ON  ONE  SIDE  OF  THE 
INTERFACE.  THE  BACKGROUND  NOISE  IS  TYPICAL  FOR  A SMOOTH  HOLE. 


TAPE  NO.  23.  SCAN  OF  HOLE  NO.  DI3.  THIS  SHOWS  TYPICAL  NOISE  FROM  HOLES  IN  THIS  SECTION  OF 
THE  STRUCTURE. 


TAPE  NO.  24.  SCAN  OF  HOLE  NO.  D35.  THIS  SHOWS  EXCESSIVE  NOISE  WHICH  INDICATES  A ROUGH  HOLE, 
A HOLE  CONTAMINATED  WITH  SEALANT  OR  IMPROPER  SET  UP, 


TAPE  NO.  25.  SCAN  OF  HOLE  NO.  C24.  THIS  SHOWS  LIFT-OFF  WHICH  CAN  BE  CAUSED  BY  A DEPRESSION 
OR  AN  ISOLATED  PIECE  OF  SEALANT.  NOTE  THAT  THE  INDICATION  STARTS  IN  THE  POSITIVE 
DIRECTION  AND  THE  MAXIMUM  AMPLITUDE  IS  IN  THE  NEGATIVE  DIRECTION. 


FlRurc  5,  Gulton  System  Typical  Tapi’  Readouts  (Sheet  11  of  11) 
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NON  DESTRUCTIVE  INSPECTION 


RELIABILITY  PROGRAM 


THIS  PUBLICATION  SUPPLEMENTS  TECHNICAL  MANUAL  NONDESTRUCTIVE 
INSPECTION,  RELIABILITY  PROGRAM.  Reference  to  this  supplement 
will  be  made  on  the  title  page  of  the  basic  publication  by 
personnel  responsible  for  maintaining  the  publication  in  current 

status. 


19  NOVEMBER  197b 


1.  PURPOSE. 

The  purpose  of  this  supplement  is  to  add  procedures  for  operation  of  new  NDI 
equipment,  the  Gulton  Automatic  Eddy  Current  System. 

2.  INSTRUCTIONS. 

A.  On  page  1-1,  add  the  following  entries  to  the  table  of  contents  immediately 
following  the  BOLT  HOLE  INSPECTION  TECHNIQUE  listing. 

EDDY  CURRENT  METHOD  USING  THE  GULTON  AUTOMATIC  EDDY  CURRENT 
SCANNING  SYSTEM  1-9 

B.  On  page  1-9,  add  the  following  paragraphs  immediately  following  paragraph 

1-13. e. 
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1-13A.  EDDY  CURRENT  METHOD  USING  1HE  GULTON  AUTOMATIC  EDDY  CURRENT  SCANNING 
3YSTEM,  ~ 

1-13'B.  AUTOMATED  EDDY  CURRENT  INSTRUMENT  SET  UP  AND  CALIBRATION.  (See  Figure 

1-6A.)  The  following  instrument  set  up  and  calibration  instructions  are 
to  be  used  when  required  for  automated  procedures  in  lieu  of  the  manual 
eddy  current  bolt  hole  procedures  for  structure  samples  D,  E,  and  F. 

The  Gulton  FD-100  Automatic  Eddy  Current  Scanning  System  was  used  in 
formulating  the  Automated  Eddy  Current  Inspection  Procedures  in  Section 
II,  Structure  Samples  D,  E,  and  F. 

a.  Equipment  Set  Up: 

(1)  Open  the  FD-100  instrument  case  and  remove  all  cables  and  the 
scanner  head  from  the  storage  compartment. 

(2)  Connect  the  scanner  head  cable  to  the  MOTOR  connector  on  the 
FD-100  instrument. 

(3)  Connect  the  RF  signal  cable  to  the  SIGNAL  connector  on  the 
FD-100  instrument. 

(4)  Connect  the  three-wire  power  cable  to  the  FD-100  and  plug  into 
a 60  Hz  1 15  VAC  grounded  outlet. 

The  FD-100  system  uses  a safety  grounded,  three-wire 
AC  power  input.  DO  NOT  ATTEMPT  TO  CHEAT  OR  DEFEAT  THE 
BUILT-IN  SAFETY  GROUND.  In  the  event  that  a properly 
grounded  115  VAC,  60  Hz  three-prong  source  is  not 
available  and  it  is  desired  to  use  an  ungrounded  two- 
wire  source,  use  a three-wire  to  two-wire  adapter  with 
built-in  grounding  pigtail.  Ensure  that  the  pigtail  is 
properly  connected  to  a good  external  ground  base  or, 
preferably,  to  an  earth  ground. 

(5)  Place  power  switch  to  ON,  allow  the  equipment  to  warm  up  for 
ten  (10)  minutes,  and  set  MODE  SELECTOR  switch  on  the  ED-520 
to  ”L0"  position, 

(6)  Select  the  eddy  current  probe  which  is  to  be  used. 

(7)  Insert  the  probe  into  the  scanner  head  as  follows:  Locate  the 

"T”  shaped  groove  on  the  connector  end  of  the  probe.  Line  up 

the  "T"  on  the  probe  with  the  index  nark  on  the  top  surface  of 
the  scanner  head  gear  and  plug  in  the  probe.  Turn  the  probe 
clockwise  t'j  i in  position.  When  withdrawing  the  probe  fol- 
lowing an  inspection,  locate  the  center  of  the  MTM  by  feel  and 
pull  straight  out.  It  may  be  necessary  to  rotate  the  probe 
out  about  one  (1)  4-nch  in  order  to  get  a hold  on  the  probe. 

The  probe  plugs  into  one  end  of  a rotating  double  ended  ner- 
cury  wetted  connector;  the  other  end  of  the  connector  is 
attached  to  the  coaxial  signal  cable  on  the  FD-100  control 
panel. 
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(8)  Rotate  the  probe  into  the  scanning  head  until  the  scanner 
automatically  stops  against  the  bottom  stop. 

CAUTION 

Do  not  adjust  the  thumbwheel  limit  switch  adjust- 
ment until  the  scanner  has  stopped  automatically 
against  the  bottom  stop.  Failure  to  comply  could 
damage  the  drive  mechanism  and  require  disassembly 
in' order  to  make  repairs. 

(9)  Rotate  the  scanner  thumbwheel  For  desired  probe  travel. 
(Adjustable  from  zero  to  approximately  1-1/2-inches.) 

Calibration: 

(1)  Set  the  equipment  up  as  directed  in  paragraph  a. 

(2)  Set  the  MODE  SELECTOR  switch  to  "LO"  position. 

(3)  Set  the  SENSITIVITY  control  to  a mid  range  position. 

(4)  Set  the  LIFT-OFF /FREQ  control  1/2  revolution  clockwise  from 
zero  at  approximately  0050. 

(5)  Place  a 0.007  inch  thick  piece  of  masking  tape  on  either 
supplied  standard. 

NOTE 

When  calibration  is  done  on  the  supplied  standard, 
ensure  that  a location  which  i3  free  of  paint  is 
used. 

(6)  Place  the  probe  on  the  material  used  for  calibration. 

(7)  Bring  the  needle  on  scale  with  the  BALANCE  control.  If  unable 
to  bring  the  needle  back  on  scale  with  the  BALANCE  control, 
advar.ee  the  LIFT-OFF /FRED  control  clockwise  until  the  needle 
comes  on  scale. 

(8)  Adjust  the  LIFT-OFF /FREQ  control  clockwise  until  the  first 
null  point  is  located:  "sing  the  BALANCE  control  to  keep  the 
needle  on  scale.  The  required  null  point  is  recognized  w.ion 
one  needle,  swinging  up  scale,  stops  and  reverses  direction  as 
the  LTFT-OFF/FREQ  control  is  rotated  in  a constant  clock isc 
direction.  If  the  needle  cannot  b*>  kept  on  :J.eale  with  the 
BALANCE  control,  continue  to  rotate  the  LIFT-OFF/KRSQ  control 
until  the  needle  returns  to  scale. 
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(9)  After  the  null  point  is  reached,  turn  the  LIFT-OFF/FREQ 
control  counterclockwise  a small  amount  to  stay  on  the  front 
side  of  the  null.  Move  the  probe  on  to  the  tape  and  note 
direction  of  needle  deflection.  The  needle  should  deflect  up 
scale.  If  the  needle  deflects  up  scale,  increase  the 
frequency  by  turning  the  LIFT-OFF /'FREQ  control  a smill  amount 
counterclockwise.  Continue  moving  the  probe  from  metal  to 
tape  and  adjusting  the  two  controls  until  there  is  a maximum 
deflection  of  only  one  (1)  minor  division  up  scale.  If  the 
needle  deflects  down  scale  when  the  probe  is  moved  from  metal 
to  tape,  decrease  the  frequency  by  turning  the  LIFT-OFF/FREQ 
control  a small  amount  clockwise.  Continue  to  move  the  probe 
from  metal  to  tape  and  adjusting  the  controls  until  there  is  a 
maximum  deflection  of  only  one  (1)  minor  division  up  scale. 

(10)  Lock  the  LIFT-OFF/FREQ  control. 


NOTE 


i 

4 


On  most  probes  the  final  calibration  frequency  will 
be  between  0050  and  0150  on  the  control  dial. 

C.  After  page  1-11,  add  figures  No.  1-6A  and  1— 6B . 

D.  On  page  2-21,  add  the  following  procedure  after  NDI  Procedure  No.  2. 

2-21  A.  NDI  PROCEDURE  NO.  3 - AUTOMATED  EDDY  CURRENT  BOLT  HOLE  INSPECTION. 


a.  NDI  equipment: 

(1)  Crack  Detector,  Gulton  FD- ICO  Automatic  Eddy  Current  Bolt  Hole 
Scanning  System. 

(2)  Probes,  Bolt  Hole,  3/16-inch  diameter,  1/4-inch  diameter,  and 
5/16-inch  diameter;  P/N  402748-1,  -3,  -5  or  equivalent. 

(3)  Calibration  Standard,  Aluminum.  (See  Figure  1-bB. ) 

b.  Access:  The  fastener  holes  are  readily  accessible. 

c.  Preparation  of  part:  Remove  all  sealant  and  coatings  from  the 
hole. 

d.  Instrument  settings/calibration:  Refer  to  paragraph  titled 
Automated  Eddy  Current  Instrument  Set  Up  and  Calibration,  in 
Section  1 of  this  manual. 

e.  ED  250  equipment  set  up  prior  to  inspection: 

(1)  Set  the  equipment  up  and  calibrate  in  accordance  with 
paragraph  1-13B. 
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CAUTION 

Do  not  adjust  the  thumbwheel  limit  switch  adjust- 
ment until  the  scanner  has  stopped  automatically 
against  the  bottom  atop.  Failure  to  comply  could 
damage  the  drive  mechanism  and  require  disassembly 
in  order  to  make  repairs. 

(2)  Set  the  maximum  probe  travel  limit  to  the  depth  of  the  hole 
that  is  to  be  inspected  by  referring  to  the  dimensioned 
drawings  for  structure  sample  D. 

(3)  Move  the  probe  to  the  bottom  stop  (full  retracted  position) 
and  insert  the  probe  into  the  hole  that  is  to  be  inspected. 

(4)  Adjust  the  BALANCE  control  for  10  percent  of  full  scale 
reading. 

(5)  Index  the  probe  into  approximately  the  middle  of  the  thickest 
layer  of  material  to  be  inspected. 

(6)  Adjust  the  sensitivity  control  for  90  percent  of  full  scale 
reading. 

(7)  Repeat  until  10  percent  and  90  percent  readings  are  obtained, 
f.  Set  the  FD-100  controls  as  follows: 


(1) 

Chart  Speed 

SLOW 

(2) 

Mode  Selector  Switch  (Function) 

LO 

(3) 

Recorder  Gain 

MAX 

(4) 

Scan 

75  RPM 

(5) 

Auto-Off-On 

AUTO 

(6) 

Filter 

50  RPM 

(7) 

Scanner  Head  Switch  Positions 

Center 

OFF 

Extend 

INTO  HOLE 

Retract 

OUT  OF  HOLE 
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NOTE 

Recorder  gain  may  need  to  be  changed  in  order 
to  obtain  the  best  signal  to  noise  ratio. 

g.  Inspection:  Scan  the  entire  inner  surfaces  of  the  indicated  holes 
of  each  diameter  in  the  sample  as  illustrated  in  figure  1-6B. 

NOTE 

Ensure  that  the  probe  is  set  at  the  bottom 
stop  (full  retracted  position)  before  ad- 
justing the  limit  switch. 

( 1 ) Place  the  probe  in  the  hole  that  is  to  be  inspected  and 
depress  the  switch  on  the  scanner  in  the  direction  in  which 
the  probe  is  to  travel. 

NOTE 

The  recorder  and  scan  will  start  and  stop 
simultaneously. 

(2)  Observe  the  meter  and  chart  deflections.  A defect  indication 
will  be  noted  by  a sharp  meter  deflection  down  scale  and  a 
chart  deflection  down  scale,  then  up  scale,  and  then  down 
scale  again. 

(3)  If  a defect  is  indicated,  clean  the  hole  and  repeat  the 
inspection.  If  the  defect  indication  persists,  report  the 
hole  as  having  a defect. 

NOTE 

If  the  defect  indication  on  the  recorder  from 
a specific  hole  goes  off  scale,  or  too  much 
noise  is  observed,  decrease  the  gain. 

(4)  Record  the  results  of  the  inspection  on  applicable  drawings  or 
forms  as  instructed  during  the  technician  briefing. 

(5)  Identify  all  recording  charts  by  narking  the  ends  with  the 
following  information: 

(a)  Structure  sample  designation. 

(b)  Hole  number. 

(c)  Date. 

(d)  Technician's  program  identification  number. 
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(6)  Mark  individual  recordings  as  follows: 

(a ) Hole  number. 

(b)  Defect  indication  if  any. 

E.  On  page  2-2b , revise  paragraph  2-25  title  to  read  as  follows: 

2-25.  NDT  PROCEDURE  NO.  1 - EDDY  CURRENT  BOLT  HOLE . 

F.  ' On  page  2-26,  add  the  following  procedure. 

2- 25 A.  ND1  PROCEDURE  NO.  2 - AUTOMATED  EDDY  CURRENT  BOLT  HOLE  INSPECTION. 

a.  NDI  equipment 

(1)  Crack  Detector,  Gultcn  FD-100  Automatic  Eddy  Current  Bolt  Hole 
Scanning  System. 

(2)  Probes,  Bolt  Hole,  5/16-inch  diameter,  P/N  402748-5. 

(3)  Calibration  Standard,  Aluminum.  (See  Figure  1-6B. ) 

b.  Access:  The  fasteners  are  readily  accessible. 

c.  Preparation  of  part:  Remove  all  sealant  and  coatings  from  the 

hole. 

d.  Instrument  .settings/calibration:  Refer  to  paragraph  titled 

Automated  Eddy  Current  Instrument  Set  Up  and  Calibration,  in 

Section  1 of  this  manual. 

e.  ED  250  Equipment  set  up  prior  to  inspection: 

(1)  Set  the  equipment  up  and  calibrate  in  accordance  with 
paragraph  1—1 3B . 

CAUTION 

Do  not  adjust  the  thumbwheel  limit  switch  adjust- 
ment until  the  scunner  has  stopped  automatically 
against  the  bottom  stop.  Failure  to  comply  could 
damage  the  drive  mechanism  and  require  disassembly 
in  order  to  make  repairs. 

(2)  Set  the  mximum  probe  travel  limit  to  the  depth  of  the  hole 
that  is  to  be  inspected  by  referring  to  the  dimensioned 
drawings  for  structure  sample  E. 


(3)  Move  the  probe  to  the  bottom  stop  (full  retracted  position^ 
and  insert  the  probe  into  fcV  hole  that  is  to  be  inspected. 
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(4) 

(5) 

(6) 

(7) 

Set 

(1) 

(2) 

(3) 

(4) 

(5) 

(6) 
(7) 


Adjust  the  BALANCE  control  for  10  percent  of  full  scale 
reading. 

Index  the  probe  into  approximately  the  middle  of  the  thickest 
layer  of  material  to  be  inspected. 

Adjust  the  sensitivity  control  for  90  percent  of  full  scale 
reading. 

Repeat  until  10  percent  and  90  percent  readings  are  obtained. 


the  FD-100  controls  as  follows: 

Chart  Speed  SLOW 

Mode  Selector  Switch  (Function)  LO 
Recorder  Gain  MAX 

Scan  75  RPM 

Auto-Off-On  AUTO 

Filter  50  RPM 

Scanner  Head  Switch  Positions 
Center  OFF 

Extend  INTO  HOLE 

Retract  OUT  OF  HOLE 


NOTE 


Recorder  gain  may  need  to  be  changed  in  order 
to  obtain  the  best  signal  to  noise  ratio. 

g.  Inspection:  Scan  the  entire  inner  surfaces  of  the  indicated  holes 
of  each  diameter  in  the  sample  as  illustrated  in  figure  1-6B. 

NOTE 

Ensure  that  the  probe  is  set  at  the  bottom  stop 
(full  retracted  position)  before  adjusting  the 
limit  switch. 

(1)  Place  the  probe  in  the  hole  that  is  to  be  inspected  and 

depress  the  switch  on  the  scanner  in  the  direction  in  which 
the  probe  is  to  travel. 
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NOTE 

The  recorder  and  scan  will  start  and  stop 
simultaneously. 

(2)  Observe  the  meter  and  chart  deflections.  A defect  indication 
will  be  noted  by  a sharp  meter  deflection  down  scale  and  a 
chart  deflection  down  scale,  then  up  scale,  and  then  down 
scale  again. 

(3)  If  a defect  is  indicated,  clean  the  hole  and  repeat  the 
inspection.  If  the  defect  indication  persists,  report  the 
hole  as  having  a defect. 

NOTE 

If  the  defect  indication  on  the  recorder  rrom 
a specific  hole  is  too  large,  or  too  much  noise 
is  observed,  decrease  the  gain. 

(if)  Record  the  results  of  the  inspection  on  applicable  drawings  or 
forms  as  instructed  during  the  technician  briefing. 

(5)  Identify  all  recording  charts  by  marking  the  ends  with  the 
following  information: 

(a)  Structure  sample  designation. 

(b)  Hole  number. 

(c)  Date. 

(d)  Technician's  program  identification  number. 

(6)  Mark  individual  recordings  as  follows: 

(a)  Hole  number. 

(b)  Defect  indication  if  any. 

On  page  2-29,  add  the  following  procedure  after  NDI  Procedure  No.  2. 

2- 30 A.  NDI  PROCEDURE  NO.  3 - AUTOMATED  EDDY  CURRENT  BOLT  HOLE  INSPECTION, 
a.  NDI  equipment: 

(1)  Crack  Detector,  Gulton  FD-100  Automatic  Eddy  Current  Bolt  Hole 
Scanning  System. 

(2)  Probes,  Bolt  Hole,  1/4-inch  diameter,  and  5/16-inch  diameter; 
P/N  4027^8  -3,  -5  or  equivalent. 

(3)  Calibration  Standard,  Aluminum.  (Sec  Figure  1-6B.) 
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b.  Access:  The  fasteners  are  readily  accessible. 

c.  Preparation  of  part:  Remove  all  sealant  and  coatings  from  the 

hole. 

d.  Instrument  set tings /calibration:  Refer  to  paragraph  titled 

Automated  Eddy  Current  Instrument  Set  Up  and  Calibration,  in 

Section  1 of  this  manual. 

e.  ED  250  Equipment  set  up  prior  to  inspection: 

(1)  Set  the  equipment  up  and  calibrate  in  accordance  with 
paragraph  1-13B. 

CAUTION 

Do  not  adjust  the  thumbwheel  limit  switch  adjust- 
ment until  the  scanner  has  stopped  automatically 
against  the  bottom  stop.  Failure  to  comply  could 
damage  the  drive  mechanism  and  require  disassembly 
in  order  to  make  repairs. 

(2)  Set  the  maximum  probe  travel  limit  to  the  depth  of  the  hole 
that  is  to  be  inspected  by  referring  to  the  dimensioned 
drawings  for  structure  sample  F. 

(3)  Move  the  probe  to  the  bottom  stop  (full  retracted  position) 
and  insert  the  probe  into  the  hole  that  is  to  be  inspected. 

(4)  Adjust  the  BALANCE  control  for  10  percent  of  full  scale 
reading. 

(5)  Index  the  probe  into  approximately  the  middle  of  the  thickest 
layer  of  material  to  be  inspected. 

(6)  Adjust  the  sensitivity  control  for  90  percent  of  full  scale 
reading. 

(7)  Repeat  until  10  percent  and  90  percent  readings  are  obtained. 
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f.  Set  the  FD-100  controls  as  follows: 


(1) 

Chart  Speed 

SLOW 

(2) 

Mode  Selector  Switch  (Function) 

LO 

(3) 

Recorder  Gain 

MAX 

(4) 

Scan 

75  RPM 

(5) 

Auto-Off-On 

AUTO 

(6) 

Filter 

50  RPM 

(7) 

Scanner  Head  Switch  Positions 

Center 

OFF 

Extend 

INTO  HOLE 

Retract 

OUT  OF  HOLE 

NOTE 


Recorder  gain  may  need  to  be  changed  in  order 
to  obtain  the  best  signal  to  noise  ratio. 

g.  Inspection:  Scan  the  entire  inner  surfaces  of  the  indicated  holes 
of  each  diameter  in  the  sample  as  illustrated  in  figure  1-6B. 

NOTE 

Ensure  that  the  probe  is  set  at  the  bottom 
stop  (full  retracted  position)  before  adjust- 
ing the  limit  switch. 

( 1 ) Place  the  probe  in  the  hole  that  is  to  be  inspected  and 
depress  the  switch  on  the  scanner  in  the  direction  in  which 
the  probe  is  to  travel. 

NOTE 

The  recorder  and  scan  will  start  and  stop 
simultaneously . 

(2)  Observe  the  meter  and  chart  deflections.  A deflect  indication 
will  be  noted  by  a sharp  meter  deflection  down  scale  and  a 
chart  deflection  down  scale,  then  up  scale,  and  then  downscale 
again. 
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(3)  If  a defect  is  indicated,  clean  the  hole  and  repeat  the 
inspection.  If  the  defect  indication  persists,  report  the 
hole  as  having  a defect. 

NOTE 

If  the  defect  indication  on  the  recorder  from 
a specific  hole  is  too  large,  or  too  much  noise 
is  observed,  decrease  the  gain. 

(H)  Record  the  results  of  the  inspection  on  applicable  drawings  or 
fonts  as  instructed  during  the  techniques  briefing. 

(5)  Identify  all  recording  charts  by  marking  the  ends  with  the 
following  information: 

(a)  Structure  sample  designation. 

(b)  Hole  number. 

(c)  Date. 

(d)  Technician's  program  identification  number. 

(6)  Mark  individual  recordings  as  follows: 

(a)  Hole  number. 

(b)  Defect  indication  if  any. 


THE  END 
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I.  ULTRASONIC  METHOD  USING  THE  SA-ALC  360  DEGREE  ROTATIONAL  SCANNER  SYSTEM. 


II.  DESCRIPTION  OF  SYSTEM.  (See  figure  1.) 

The  Rotational  Scanner  System  i3  used  to  inspect  fastener  holes  for  radial 
cracks  without  removing  the  fasteners.  It  consists  of  a manual  scanner  head 
assembly,  a transducer  assembly,  and  accessories,  and  an  ultrasonic  reflecto- 
scope . 

a.  The  scanner  head  assembly  consists  of:  three  adjustable  legs,  a 
centering  device  for  positioning  the  assembly  on  a fastener  head, 
an  adjustable  transducer  holder,  and  a transducer  assembly.  The 
transducer  holder  is  adjustable  for  alignment  of  the  transducer 
sound  beam  to  the  edge  of  a hole.  The  holder  can  be  adjusted  in 
three  directions;  tangential,  radial,  and  angular.  These 
adjustments  allow  the  operator  to  direct  a shear  wave  to  the  base 
of  a countersink.  The  tangential  adjustment  moves  the  transducer 
assembly  toward  and  away  from  a fastener  hole.  The  radial  adjust- 
ment moves  the  transducer  assembly  to  right  or  left  of  a fastener 
hole.  The  angle  is  adjustable  using  a template  to  set  it  at  the 
desired  angle  for  sound  entry  into  a part.  This  adjustment,  once 
it  is  set,  is  fixed  and  cannot  be  continuously  adjusted  to  maximize 
the  signal  response. 

b.  The  transducer  assembly  consists  of  a transducer,  a transducer 
sleeve,  water  and  a flexible  boot.  The  transducer  assembly  screws 
into  the  transducer  holder.  A water  column,  confined  by  means  of 
the  transducer,  transducer  sleeve  and  flexible  boot,  transmits 
sound  through  the  rubber  boot  to  the  test  piece. 

c.  The  reflectosoope  (figure  2)  used  in  conjunction  with  the  manual 
scanner  head  assembly  is  Automation  Industries  P/N  UM775D  with  an 
AGIFM  Timer  and  a 10NRF-VDB  Pulser/Receiver . The  gate  and  alarm 
for  the  Reflectosoope  are  on  the  internal  panel.  Access  to  this 
panel  is  gained  by  turning  the  lock  counterclockwise  and  pulling 
the  drawer  out. 

III.  FUNCTION  OF  CONTROLS.  (See  figure  2.) 

a.  PULSER  RECEIVER  CONTROLS: 

1.  PULSE  LENGTH  control.  This  control  is  used  to  adjust  the  time 
duration  of  the  high  frequency  pulse  applied  to  the  trans- 
ducer. It  should  be  adjusted  for  maximum  signal  return  while 
maintaining  required  resolution.  (Normally  it  i3  left  near 
minimum  and  increased  only  to  gain  signal  strength  when  max- 
imum sensitivity  does  not  suffice;  excessive  pulse  length  can 
obscure  signals  from  defects  close  to  the  te3t  surface.) 
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2.  PULSE  TUNING  control  This  control  is  a capacitive  adjustment 
which  compensates  for  slight  variations  in  distributed 
capacitance  and  other  characteristics  between  cables  and 
transducers.  Depending  on  the  requirements  of  the  te3t 
situation,  it  should  be  adjusted  to  produce  either  the  largest 
or  most  distinct  indications. 

3-  REJECT  control.  This  control  is  used  to  block  the  passage  of 
low  level  irrelevant  signals  and  noise  signals  for  a clean  CRT 
presentation  which  permits  easier  interpretation  of  echo 
signals. 

4.  FREQUENCY  switch.  This  switch  is  used  to  select  the  operating 
frequency  desired.  The  selected  frequency  normally  corre- 
sponds to  the  operating  frequency  of  the  transducer  being 
used . 

5.  VIDEO/RF  switch.  This  switch  is  used  to  select  one  of  two  CRT 
display  modes,  either  detected  video. or  RF. 

6.  TEST  THRU/NORMAL  switch.  This  two-position  switch  is  used  to 
select  one  of  two  possible  test  modes.  In  the  THRU  position, 
two  transducers  are  used;  one  transmits  the  high  frequency 
pulse  to  the  test  specimen,  the  other  receives  the  signals 
from  the  test  specimen  and  sends  pulses  to  the  RF  amplifier 
via  the  RECEIVER  jack.  In  the  NORMAL  position,  only  one  trans- 
ducer is  used  and  this  transducer  functions  as  the  transmitter 
and  receiver  of  the  high  frequency  pulse. 

7.  SENSITIVITY  controls.  Three  controls  are  provided  to  adjust 
the  gain  of  the  RF  amplifier.  A three-position  slide  switch 
allows  coarse  selection  of  three  levels  of  gain:  0,  20,  40 
dB.  A stepped  rotary  switch  permits  fine  adjustments  in  2 dB 
steps  (from  0 to  20  dB)  within  the  gain  level  selected.  A 
toggle  switch  marked  0 and  1 allows  further  fine  adjustment  of 
1 dB,  when  needed.  An  additional  screwdriver  control  marked 
CAL  may  be  used  to  adjust  the  gain  in  a continuous  manner 
(within  approximately  a 20  dB  range)  if  desired.  This  is  use- 
ful for  aligning  an  echo  on  a certain  graticule  line  during 
setup. ) 

8.  R (RECEIVER)  connector.  The  left  receptacle  marked  R is  used 
under  the  following  conditions: 

(a)  When  testing  in  the  pulse-echo  mode  (one  transducer  used 
and  TEST  switch  set  at  NORMAL;  U3ing  quartz  or  lithium 
sulfate  transducers  with  short  cable). 

(b)  When  testing  in  the  through  transmission  mode  (two  trans- 
ducers used  and  TEST  switch  set  at  THRU).  Receiving 
transducer  cable  is  connected  to  R receptacle. 
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°*  T (TRANSMITTER)  connector.  The  right  receptacle  marked  T is 

used  under  the  following  conditions: 

(a)  When  testing  in  the  pul3e-eeho  mode  (one  transducer)  and 
using  barium  titanite,  lead  zirconate,  or  lead 
metaniobate  types,  or  when  cable  is  longer  than  6 feet,  4 
inches. 

(b)  When  testing  in  the  through  (THRU)  transmission  mode  with 
transmitting  transducer  cable  connected  to  T receptacle. 

b.  AGIFM  TIMER  CONTROLS. 

1.  Front  Panel  Control  Groups: 

(a)  Horizontal  delay  controls  give  coarse,  fine  and  stepped 
control  over  sweep  delay.  This  enables  working  over  a 
great  range  of  material  thickness. 

(b)  1110  time  or  rate  controls  give  coarse,  fine  and  stepped 
control  over  the  CRT  sweep  speed  and  thereby  the  relative 
expansion/contraction  of  the  horizontal  viewing  time 
scale;  i.e.,  horizontal  signal  magnification  and/or  cali- 
bration for  different  materials. 

(c)  The  marker  group  gives  coarse,  fine  and  stepped  control 
over  pulse  repetition  frequency  of  the  square  wave  marker 
scale.  It  is  also  possible  to  shift  the  markers  inde- 
pendently with  regard  to  horizontal  position. 

(d)  Vertical,  alternate,  horizontal,  and  marker  shift  con- 
trols displace  the  CRT  trace  independently  of  any  time 
related  function. 

Front  Panel  Controls: 

(a)  DELAY  (CRS).  Coarse  control  over  the  duration  of  sweep 
delay.  (Delay  enables  the  operator  to  center  signals  re- 
gardless of  thickness  of  material.) 

(b)  DELAY  (FINE).  Vernier  control  over  the.  duration  of  sweep 
delay.  (MAX-MIN  rotational  directions  are  indicated  on 
controls  (a)  and  (b)  above.) 

(o)  SWEEP  DELAY  MICROSECONDS.  Gives  three  step  control  over 
sweep  delay  from  0 to  500  microseconds. 

(d)  SWEEP  (CRS).  Controls  the  duration  of  the  sweep  pulse. 
(Sweep  rate  enables  the  horizontal  expansion/contraction 
of  displayed  waveforms  and  calibration  against  the 
graticule  system.) 
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(e)  SWEEP  (MATL).  Varies  horizontal  calibration  to  compen- 
sate for  propagation  velocity  of  materials. 

(f)  SWEEP  RANGE  INCP^S/DIV.  Gives  five  3tep  controls  over 
sweep  range  from  .02  to  10  inches/division. 

(g)  MODE  (SHEAR).  Compensates  for  difference  between  longi- 
tudinal and  shear  velocity  in  steel. 

(h)  VERTICAL  and  HORIZ.  Displaces  primary  trace  position. 
ALTN  displaces  marker  baseline  along  the  vertical  axis. 

(i)  RATE.  Controls  the  basic  pulse  repetition  rate  of  the 
timer  circuitry.  (100  to  200  Hz) 

(j)  MARKER  RANGE  CRS.  Turns  marker  function  "on"  and  may  be 
set  to  three  stepped  ranges  of  marker  repetition  rates. 

(k)  (MARKER  RANGE  FINE.  Fine  adjustment  of  marker  repetition 
rate. 

(l)  MARKER  SHIFT.  Adjusts  horizontal  position  of  marker 
trace. 

3.  Internal  Panel  Controls: 
i.See  figure  3.) 

(a)  GATE  START  (FINE).  Varies  time  constant  of  gate  start 
circuit  by  varying  R/C  network  resistance. 

(b)  GATE  START  (CRS).  Varies  time  constant  of  gate  start 
circuit  by  large  R/C  capacitor  steps. 

(c)  GATE  LENGTH  (FINE).  Varies  time  constant  of  gate  length 
circuit  by  varying  R/C  network  resistance. 

(d)  GATE  LENGTH  (CRS).  Varies  time  constant  of  gate  length 
circuit  large  R/C  capacitor  steps. 

(e)  IF  SYNC.  Enable/defeat  IF  sync  function.  A three 
position  switch  synchronizes  time  of  start  of  gate  and 
sweep  to  compensate  for  variations  in  length  of  water 
path  in  immersion  testing. 

(1)  IF  SYNC-GATE  SWP.  Gate  and  sweep  are  started  by 
. first  video  signal  (interface). 

(2)  IF  SYNC-GATE.  Gate  only  is  started  by  interface 
signal. 

(3)  IF  SYNC-OFF.  Interface  synchronization  capability 
disabled.  Cate  is  started  from  "main  sync"  time  and 
sweep  is  started  after  sweep  delay. 
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(f)  GATE  ON-OFF.  Enable/defeat  gate  function. 

(g)  AURAL  ON-OFF.  Enable/defeat  auditory  alarm. 

(h)  ALARM  POLARITY  +.  Alarm  on  + or  - video  signal. 

(i)  ALARM  LEVEL.  Sets  video  level  at  which  alarm  signal  is 
activated. 

DISPLAY  CHASSIS  CONTROLS.  (See  figure  2.) 

1.  Display  Chassis  Controls.  The  operator  controls  located  on 
the  display  chassis  are  the  power  switch,  astigmatism,  inten- 
sity, and  focus  controls.  The  last  three  controls  are  screw- 
driver adjustable  because,  once  set  for  optimum  conditions, 
they  do  not  usually  require  readjustment. 

2.  Functions  of  Controls: 

(a)  FDWER  switch.  This  switch  is  pressed  once  to  turn  Re- 
flectoscope  power  on,  and  pressed  again  to  turn  power 
off.  When  power  is  on,  the  switch  is  illuminated. 

(b)  ASTIG  (Astigmatism).  Screwdriver  adjusted  control  which 
corrects  for  distortion  of  the  CRT  trace.  Used  in  con- 
junction with  the  FOCUS  control  to  obtain  sharpest  trace 
line. 

(c)  FOCUS.  Screwdriver  adjusted  control  which  is  adjusted  to 
obtain  the  sharpest  trace  line. 

(d)  INTENSITY.  Screwdriver  adjusted  control  for  adjusting 
the  brightness  of  the  CRT  trace.  Adjustment  of  the 
INTENSITY  control  usually  necessitates  a readjustment  of 
the  FOCUS  and  ASTIG  controls  to  return  the  trace  to  its 
sharpest  appearance . 
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NDI  PROCEDURE  NO.  2 - ULTRASONIC. 

a.  NDI  equipment: 

(1)  Refleetoscope,  Automation  Industries,  P/N  UM775D. 

(2)  Transducer,  10  MHz,  3/16  dia. , longitudinal  wave,  P/N  SPO-574, 
2 required. 

(V  Cable,  12  foot,  90  degree,  Microdot/UHF  Connector  Sperry  P/N 
57A2270,  2 required. 

(l>)  Video  Plug-In  Module  10NRF-VDB. 

(5)  Couplant,  light  oil. 

(6)  Calibration  Standard,  as  illustrated. 

(7)  SA-ALC  360  Degree  Scanner  Head  Assembly. 

(8)  26  Degree  Template. 

b.  Access:  The  exterior  skin  surface  where  inspections  are  to  be 

performed  is  readily  accessible. 

c.  Preparation  of  Part:  Clean  local  inspection  areas  a3  required  to 

permit  good  contact  between  part  and  transducer. 

d.  Assembly: 

(1)  Assemble  the  transducers  and  sleeves  as  illustrated.  (See 
figure  O 

(2)  Screw  the  transducer/sleeve  assembly  into  the  transducer  hold- 
ing fixture. 

(3)  Using  the  26  degree  template,  set  the  transducers  to  an  angle 
of  26  degrees.  This  can  be  accomplished  by  loosening  the 
alien  screw  that  secures  the  holder  in  position,  then  set  the 
holder  to  the  26  degree  angle  and  tighten  the  alien  screw. 

(See  figure  5. ) 

(A)  Place  the  scanning  head  assembly  on  the  standard  (ligure  6), 
and  adjust  the  three  scanner  legs  to  provide  an  acceptable  and 
uniform  boot  contact  pressure.  (See  figure  7.) 

(5)  Connect  the  transducer  cables  to  the  transducers  and  to  the 
"T"  Receptacle  of  the  UM775D  Refleetoscope. 

e.  Instrument  settings/calibration: 

(1)  Depress  the  Refleetoscope  power  switch  to  the  ON  position  and 
allow  the  unit  to  warm  up  for  five  minutes. 
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(2)  Adjust  the  Reflectoscope  to  the  following  preliminary 


settings: 

vO) 

Sweep  Delay 

0-5 

(b) 

MODE 

SHEAR 

(c) 

SWEEF  RANGE 

. 1 

(d) 

PULSE  LENGTH 

Max  (Full  CW) 

(e) 

PULSE  TUNING 

Max  (Full  CW) 

(f) 

REJECT 

1/3  Turn  CW 

(S) 

RF/VIDEO  Switch 

VIDEO 

(h) 

TEST  Switch 

NORMAL 

(i) 

Frequency 

10.0  MHz 

(J) 

DB  Switch 

0 

(k) 

DB  Knob 

18 

(3)  Place  the  Scanner  Head  Assembly  on  the  standard  with  the 
center  positioner  in  the  fastener  hole  with  the  fastener 
removed.  (See  figure  6.) 

NOTE 

Only  one  transducer  can  be  activated  at  a time. 

(4)  Position  the  switch  to  activate  one  of  the  two  transducers. 

(5"1  Using  the  radial  adjustment  knob,  position  the  C/L  of  the 
activated  transducer  to  align  with  the  C/L  of  the  fastener 
hole  which  has  the  sawcut.  (See  figure  8.) 

(6)  Adjust  the  tangential  adjustment  knob  until  a back  reflection 
from  the  fastener  hole  appears  on  the  CRT  screen.  (See 
figure  9. ) 

(7)  Maximize  the  signal  from  the  fastener  hole  using  both  the  tan- 
gential and  radial  adjustment  knobs. 

(8)  Using  the  sweep  and  delay  controls,  position  the  initial  pulse 
near  the  left  hand  side  of  the  CRT  screen  and  the  back  reflec- 
tion frem  the  fastener  hole  near  the  center  of  the  CRT  screen. 
(See  figure  9.) 

(9)  Rotate  the  transducer  until  the  sound  path  is  90  degrees  to 
the  radial  direction  of  the  sawcut.  (See  figure  8.) 

(10)  Using  the  radial  direction  knob  adjust  the  transducer  until  it 
is  aligned  with  the  sawcut. 

(11)  Using  the  tangential  knob,  move  the  transducer  towards  the 
sawcut  until  an  indication  from  the  sawcut  appears  on  the  CRT 
screen.  (See  figures  8 and  9.) 
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(10)  Using  the  tangential  and  radial  direction  knobs,  maximize  the 
back  reflection  from  the  sawcut. 


(10  With  the  sawcut  back  reflection  maximized,  adjust  the  Reflect- 
oseope  sensitivity  to  give  80  percent  of  scope  saturation  from 
the  sawcut. 

(lit)  Loosen  the  lock  and  pull  out  the  internal  panel  containing  the 
gate  controls.  (See  figure  3-) 

(1b)  Set  the  gate  controls  to  the  following  settings:  (See 
f iguure  3 • ) 

(a)  IE'  SYNC  OFF 

(b)  AURAL  ON 

(c)  GATE  ON 

(d)  ALARM  POLARITY  + 

(e)  GATE  LENGTH  CRS  2 

(f)  GATE  START  CRS  2 

(g)  GATE  LENGTH  FINE  Set  to  approx.  1/2  inch  in  length 

(h)  GATE)  START  FINE  Move  the  Gate  to  the  indication  from 

the  sawcut.  (See  figure  8.) 

(i)  ALARM  LEVEL  Set  the  alarm  level  so  that  it  will  be 

activated  when  the  back  reflection 
from  the  sawcut  reaches  the  50  percent 
level  of  scope  saturation. 

(16)  Rotate  the  transducer  360  degrees  and  note  the  CRT 
presentation  and  gate. 

(17)  The  back' reflection  from  the  sawcut  represents  a defect. 

(18)  To  calibrate  for  the  second  transducer,  position  the  switch  to 
activate  it  and  position  the  transducer  so  that  the  sound  path 
will  hft  the  sawcut  from  the  opposite  direction  of  the  first 
transducer.  (See  figure  8.) 

(19)  Repeat  steps  (5)  through  (16)  for  the  second  transducer. 
Inspection 

(')  With  the  Scanning^Systera  properly  calibrated,  apply  ccuplant 
to  the  practice  sgfcpl  and  inspect  all  accessible  fastener 
holes  with  both  S^nsducers.  (See  figure  10.) 

Mark  and  report  indicated  defects. 


u 
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AGIFM  TIMER 


Figure  2.  The  Reflectosoope 
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"O”  RING  PT . NO.  NAS  16 1 I -01 1 
(SUPPLIED  WITH  SLEEVE) 


TRANSDUCER  ASSEMBLY 


NOlf 


I . ASSEMBLE  WITH  TRANSDUCER  SLEEVE  AND  BOOT  UNDER  WATER. 
USE  DEAERATED  WATER  OR  WATER  THAT  HAS  BEEN  ALLOWED 
TO  STAND  TOR  24  HOURS  AT  ROOM  TEMPERATURE,  TO  PREVENT 
AIR  BUBBLES  FROM  FORMING  INSIDE  THE  ASSEMBLY.  DURING 
ASSEMBLY,  REMOVE  BUBBLES  FROM  THREADED  END  OF 
TRANSDUCER  ANO  FROM  INSIDE  THE  SLEEVE  AND  BOOT. 

2.  THREAD  TRANSDUCER  HALF  WAY  INTO  SLEEVE. 

J.  SLIP  BOOT  ON  END  OF  SLEEVE  AND  SEAT  BOOT  RIM  IN  SLEEVE 
GROOVE. 

4.  COMPLETE  THREADING  OF  TRANSDUCER  INTO  SLEEVE  UNTIL  IT 
SEATS  AGAINST  “O"  RING. 


Figure  4.  Transducer  Assembly 
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Figure  '5.  Installation  of  Transducer  Assembly 
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Figure  6.  Positioning  and  Adjustment  of  Scanning  Head  Assembly 
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TOO  HEAVY 


TOO  LIGHT 
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Figure  7.  Transducer  Boot  Contact  Pressure 
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Nr  MOVE  TRANSDUCER  TOWARD 
\ HOLE  UNTIL  FLAW  APPEARS 

ON  CRT.  MAXIMIZE  SIGNAL  . 
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•TRANSDUCER 
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Figure  8.  Alignment  of  Scanning  Head  Assembly  to  Hole 
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RELATIVE  POSITION 
OF  FASTENER  HOLE 


REPRESENTATION  FOR  NON-CRACKED  HOLE 


Figure  9.  CRT  Presentation 


PRACTICE 


Figure  10.  Practice  Panel 
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TECHNICAL  MANUAL 
NONDESTRUCTIVE  INSPECTION 
RELIABILITY  PROGRAM 


THIS  PUBLICATION  SUPPLEMENTS  TECHNICAL  MANUAL  NONDESTRUCTIVE 
INSPECTION,  RELIABILITY  PROGRAM.  Reference  to  this  supplement 
will  be  made  on  the  title  page  of  the  basic  publication  by  per- 
sonnel responsible  for  maintaining  the  publication  in  current 
status. 


15  DECEMBER  1976 


1 . PURPOSE. 

The  purpose  of  this  supplement  is  to  add  procedures  for  operation  of  new  NDI 
equipment,  the  SA-ALC  360  Degree  Rotational  Scanner  System. 

2.  INSTRUCTIONS. 

A.  On  page  1-1,  add  the  following  entry  to  the  table  of  contents  immediately 
following  the  FLAW  DETECTOR  EQUIVALENCY  listing. 

ULTRASONIC  METHOD  USING  THE  SA-ALC  360  DEGREE 
ROTATIONAL  SCANNER  SYSTEM  1-19 

B.  On  page  1-19,  add  the  following  paragraphs  and  figures  1-11,  1-12,  and  1-13 
immediately  following  table  1-III. 

1-21 A.  ULTRASONIC  METHOD  USING  THE  SA-ALC  360  DEGREE  ROTATIONAL  SCANNER  SYSTEM. 


1—2 IB.  DESCRIPTION  OF  SYSTEM.  (See  figure  1-11.) 

The  Rotational  Scanner  System  is  used  to  inspect  fastener  holes  for  radial 
cracks  without  removing  the  fasteners.  It  consists  of  a manual  scanner  head 
assembly,  a transducer  assembly,  and  accessories,  and  an  ultrasonic  reflecto- 
scope. 
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a.  The  scanner  head  assembly  consists  of:  three  adjustable  legs,  a 
centering  device  for  positioning  the  assembly  on  a fastener  head, 
an  adjustable  transducer  holder,  and  a transducer  assembly.  The 
transducer  holder  is  adjustable  for  alignment  of  the  transducer 
sound  beam  to  the  edge  of  a hole.  The  holder  can  be  adjusted  in 
three  directions;  tangential,  radial,  and  angular.  These 
adjustments  allow  the  operator  to  direct  a shear  wave  to  the  base 
of  a countersink.  The  tangential  adjustment  moves  the  transducer 
assembly  toward  and  away  from  a fastener  hole.  The  radial  adjust- 
ment moves  the  transducer  assembly  to  right  or  left  of  a 
fastener  hole.  The  angle  is  adjustable  using  a template  to  set  it 
at  the  desired  angle  for  sound  entry  into  a part.  This  adjustment, 
once  it  is  set,  is  fixed  and  cannot  be  continuously  adjusted  to  max- 
imize the  signal  response. 

b.  The  transducer  assembly  consists  of  a transducer,  a transducer 
sleeve,  water  and  a flexible  boot.  The  transducer  assembly  screws 
into  the  transducer  holder.  A water  column,  confined  by  means  of 
the  transducer,  transducer  sleeve  and  flexible  boot,  transmits  sound 
through  the  rubber  boot  to  the  test  piece. 

c.  The  reflectoscope  (figure  1-12)  used  in  conjunction  with,  the  manual 
scanner  head  assembly  is  Automation  Industries  P/N  UM775D  with  an 
AGIFM  Timer  and  a 10NRF-VDB  Pulser /Receiver.  The  gate  and  alarm 
for  the  Reflectoscope  are  on  the  internal  panel.  Access  to  this 
panel  is  gained  by  turning  the  lock  counterclockwise  and  pulling 
the  drawer  out. 

1-21C.  FUNCTION  OF  CONTROLS.  (See  figure  1-12.) 
a.  PULSER  RECEIVER  CONTROLS: 

1.  PULSE  LENGTH  control.  This  control  is  used  to  adjust  the  time 
duration  of  the  high  frequency  pulse  applied  to  the  trans- 
ducer. It  should  be  adjusted  for  maximum  signal  return  while 
maintaining  required  resolution.  (Normally  it  is  left  near 
minimum  and  increased  only  to  gain  signal  strength  when  max- 
imum sensitivity  does  not  suflice;  excessive  pulse  length  can 
obscure  signals  from  defects  close  to  the  test  surface.) 

2.  PULSE  TUNING  control.  This  control  is  a capacitive  adjustment 
which  compensates  for  slight  variations  in  distributed  capaci- 
tance and  other  characteristics  between  cables  and  trans- 
ducers. Depending  on  the  requirements  of  the  test  situation, 
it  should  be  adjusted  to  produce  either  the  largest  or  most 
distinct  indications. 

3.  REJECT  control.  This  control  is  used  to  block  the  passage  of 
low  level  irrelevant  signals  and  noise  signals  for  a clean  CRT 
presentation  which  permits  easier  interpretation  of  echo 
signals. 
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4.  FREQUENCY  switch.  This  switch  is  used  to  select  the  operating 
frequency  desired.  The  selected  frequency  normally  corre- 
sponds to  the  operating  frequency  of  the  transducer  being 
used. 

5.  VIDEO/RF  switch.  This  switch  is  used  to  select  one  of  two  CRT 
display  modes,  either  detected  video  or  RF. 

6.  TEST  THRU/NORMAL  switch.  This  two-position  switch  is  used  to 
select  one  of  two  possible  test  modes.  In  the  THRU  position, 
two  transducers  are  used;  one  transmits  the  high  frequency 
pulse  to  the  test  specimen,  the  other  receives  the  signals 
from  the  test  specimen  and  sends  pulses  to  the  RF  amplifier 
via  the  RECEIVER  jack.  In  the  NORMAL  position,  only  one  trans- 
ducer is  used  and  this  transducer  functions  as  the  transmitter 
and  receiver  of  the  high  frequency  pulse. 

7.  SENSITIVITY  controls.  Three  controls  are  provided  to  adjust 
the  gain  of  the  RF  amplifier.  A three-position  slide  switch 
allows  coarse  selection  of  three  levels  of  gain:  0,  20,  40 
dB.  A stepped  rotary  switch  permits  fine  adjustments  in  2 dB 
steps  (from  0 to  20  dB)  within  the  gain  level  selected.  A 
toggle  switch  marked  0 and  1 allows  further  fine  adjustment  of 
1 dB,  when  needed.  An  additional  screwdriver  control  marked 
CAL  may  be  used  to  adjust  the  gain  in  a continuous  manner 
(within  approximately  a 20  dB  range)  if  desired.  This  is  use- 
ful for  aligning  an  echo  on  a certain  graticule  line  during 

■ setup. ) 

8.  R (RECEIVER)  connector.  The  left  receptacle  marked  R is  used 
under  the  following  conditions: 

(a)  When  testing  in  the  pulse-echo  mode  (one  transducer  used 
and  TEST  switch  set  at  NORMAL;  using  quartz  or  lithium 
sulfate  transducers  with  short  cable). 

(b)  When  testing  in  the  through  transmission  mode  (two  trans- 
ducers used  and  TEST  switch  set  at  THRU).  Receiving 
transducer  cable  is  connected  to  R receptacle. 

9.  T (TRANSMITTER)  connector.  The  right  receptacle  marked  T is 
used  under  the  following  conditions: 

(a)  When  testing  in  the  pulse-echo  mode  (one  transducer)  and 
using  barium  titanite,  lead  zirconate,  or  lead 
metaniobate  types,  or  when  cable  is  longer  than  6 feet,  4 
inches. 

(b)  When  testing  in  the  through  (THRU)  transmission  mode  with 
transmitting  transducer  cable  connected  to  T receptacle. 
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I 1.  Front  Panel  Control  Croups: 

| (a)  Horizontal  delay  controls  give  coarse,  fine  and  stepped 

| control  over  sweep  delay.  This  enables  working  over  a 

\ great  range  of  material  thickness. 

1 (b)  The  time  or  rate  controls  give  coarse,  fine  and  stepped 

I control  over  the  CRT  sweep  speed  and  thereby  the  relative 

I expansion/contraction  of  the  horizontal  viewing  time 

1 scale;  i.e.,  horizontal  signal  magnification  and/or  cali- 

I bration  for  different  materials. 

jj  (c)  The  marker  group  gives  coarse,  fine  and  stepped  control 

jj  over  pulse  repetition  frequency  of  the  square  wave  maiker 

\ scale.  It  is  also  possible  to  shift  the  markers  inde- 

| pendent ly  with  regard  to  horizontal  position. 

!■  (d)  Vertical,  alternate,  horizontal,  and  marker  shift  con- 

I trols  displace  the  CRT  trace  independently  of  any  time 

\ related  function. 

| 2.  Front  Panel  Controls: 

$ 

(a)  DELAY  (CRS).  Coarse  control  over  the  duration  of  sweep 

* delay.  (Delay  enables  the  operator  to  center  signals  re- 

\ gardless  of  thickness  of  material.) 

5 

* (b)  DELAY  (FINE).  Vernier  control  over  the  duration  of  sweep 

: delay.  (MAX-MIN  rotational  directions  are  indicated  on 

j controls  (a)  and  (b)  above.) 

* 

! (c)  SWEEP  DELAY  MICROSECONDS.  Gives  three  step  control  over 

; sweep  delay  from  0 to  500  microseconds. 

t 

\ (d)  SWEEP  (CRS).  Controls  the  duration  of  the  sweep  pulse. 

» (Sweep  rate  enables  the  horizontal  expansion/contraction 

i of  displayed  waveforms  and  calibration  against  the 

j graticule  system. ) 

I 

f (e)  SWEEP  (MATL).  Varies  horizontal  calibration  to  compen- 

I sate  for  propagatioi  velocity  of  materials. 

(f)  SWEEP  RANGE  INCHES/DIV.  Gives  five  step  controls  over 
sweep  range  from  .02  to  10  inches /division. 

(g)  MODE  (SHEAR).  Compensates  for  difference  between  longi- 
tudinal and  shear  velocity  in  steel. 


1 (h) 

! 

I 


VERTICAL  and  HORIZ.  Displaces  primary  trace  position. 
ALTN  displaces  marker  baseline  along  the  vertical  axis. 
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(i)  RATE.  Controls  the  basic  pulse  repetition  rate  of  the 
timer  circuitry.  (100  to  200  Hz) 

(j)  MARKER  RANGE  CRS.  Turns  marker  function  "on''  and  may  be 
set  to  three  stepped  ranges  of  marker  repetition  rates. 

(k)  MARKER  RANGE  FINE.  Fine  adjustment  of  marker  repetition 
rate. 

(l)  MARKER  SHIFT.  Adjusts  horizontal  position  of  marker 
trace. 

Internal  Panel  Controls: 

(See  figure  1-13.) 

(a)  GATE  START  (FINE).  Varies  time  constant  of  gate  start 
circuit  by  varying  R/C  network  resistance. 

(b)  GATE  START  (CRS).  Varies  time  constant  of  gate  start 
circuit  by  large  R/C  capacitor  steps. 

(c)  GATE  LENGTH  (FINE).  Varies  time  constant  of  gate  length 
circuit  by  varying  R/C  network  resistance. 

(d)  GATE  LENGTH  (CRS).  Varies  time- constant  of  gate  length 
circuit  large  R/C  capacitor  steps. 

(e)  IF  SYNC.  Enable/defeat  IF  sync  function.  A three 
position  switch  synchronizes  time  of  start  of  gate  and 
sweep  to  compensate  for  variations  in  length  of  water 
path  in  immersion  testing. 

(1)  IF  SYNC-GATE  SWP.  Gate  and  sweep  are  started  by 
first  video  signal  (interface). 

(2)  IF  SYNC-GATE.  Gate  only  is  started  by  interface 
signal. 

(3)  IF  SYNC-OFF.  Interface  synchronization  capability 
disabled.  Gate  is  started  from  "main  sync"  time  and 
sweep  is  started  after  sweep  delay. 

(f)  GATE  ON-OFF.  Enable /defeat  gate  function. 

(g)  AURAL.  ON-OFF.  Enable/defeat  auditory  alarm. 

(h)  ALARM  POLARITY  +.  Alarm  on  + or  - video  signal. 

(i)  ALARM  LEVEL.  Sets  video  level  at  which  alarm  signal  is 
activated. 
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c.  DISPLAY  CHASSIS  CONTROLS.  (See  figure  1-12.) 

1.  Display  Chassis  Controls.  The  operator  controls  located  on 
the  display  chassis  are  the  power  switch,  astigmatism,  inten- 
sity, ar.d  focus  controls.  The  last  three  controls  are  screw- 
driver adjustable  because,  once  set  for  optimum  conditions, 
they  do  not  usually  require  read justment. 

2.  Functions  of  Controls: 

(a)  POWER  switch.  This  switch  is  pressed  once  to  turn  Re- 
flectoscope  power  on,  and  pressed  again  to  turn  power 
off.  When  power  is  on,  the  switch  is  illuminated. 

(b)  ASTIG  (Astigmatism).  Screwdriver  adjusted  control  which 
corrects  for  distortion  of  the  CRT  trace.  Used  in  con- 
junction with  the  FOCUS  control  to  obtain  sharpest  trace 
line. 

(c)  FOCUS.  Screwdriver  adjusted  control  which  is  adjusted  to 
obtain  the  sharpest  trace  line. 

(d)  INTENSITY.  Screwdriver  adjusted  control  for  adjusting 
the  brightness  of  the  CRT  trace.  Adjustment  of  the 
INTENSITY  control  usually  necessitates  a readjustment  of 
the  FOCUS  and  ASTIG  controls  to  return  the  trace  to  Its 
sharpest  appearance. 
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C.  On  page  2-3,  add  the  following  procedure  after  NDI  Procedure  No.  1. 

2-5A.  NDI  PROCEDURE  NO.  2 - ULTRASONIC. 

a.  NDI  equipment: 

(1)  Reflectoscope,  Automation  Industries,  P/N  UM775D. 

(2)  Transducer,  10  MHz,  3/ 1 6 dia. , longitudinal  wave,  P/N  SPO-574, 
2 required . 

(3)  Cable,  12  foot,  90  degree,  Microdot/UHF  Connector  Sperry  P/N 
57A2270,  2 required. 

(4)  Video  Plug-In  Module  10NRF-VDB. 

(5)  Couplant,  light  oil. 

(6)  Calibration  Standard,  as  illustrated. 

(7)  SA-ALC  3o0  Degree  Scanner  Head  Assembly. 

(8)  26  Degree  Template. 

b.  Access:  The  exterior  skin  surface  where  inspections  are  to  be  per- 
formed is  readily  accessible. 

c.  Preparation  of  Part:  Clean  local  inspection  areas  as  required  to 

permit  good  contact  between  part  and  transducer. 

d.  Assembly: 

(1)  Assemble  the  transducers  and  sleeves  as  illustrated.  (See 
figure  2-1 A.) 

(2)  Screw  the  transducer/sleeve  assembly  into  the  transducer  hold- 
ing fixture. 

(3)  Using  the  26  degree  template,  set  the  transducers  to  an  angle 
of  26  degrees.  This  can  be  accomplished  by  loosening  the 
alien  screw  that  secures  the  holder  in  position,  then  set  the 
holder  to  the  26  degree  angle  and  tighten  the  alien  screw. 

(See  figure  2-1 A.) 

(4)  Place  the  scanning  head  assembly  on  the  standard  (figure 

2-1  A),  and  adjust  the  three  scanner  legs  to  provide  an  accept- 
able and  uniform  boot  contact  pressure.  (See  figure  2-1A.) 

(5)  Connect  the  transducer  cables  to  the  transducers  and  to  the 
"T"  Receptacle  of  the  UM775D  Reflectoscope. 
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Instrument  settings/calibration: 


(1)  Depress  the  Reflectoscope  power  switch  to  the  ON  position  and 
allow  the  unit  to  warm  up  for  five  minutes. 

(2)  Adjust  the  Reflectoscope  to  the  following  preliminary 


(3) 


sett 

ings: 

(a) 

Sweep  Delay 

0-5 

(b) 

MODE 

SHEAR 

(c) 

SWEEP  RANGE 

. 1 

(d) 

PULSE  LENGTH 

Max  (Full  CW) 

(e) 

PULSE  TUNING 

Max  (Full  CW) 

(f) 

REJECT 

1/3  Turn  CW 

(g) 

RF/VIDEO  Switch 

VI  DEO 

(h) 

TEST  Switch 

NORMAL 

(i) 

Frequency 

10.0  MHz 

(j) 

DB  Switch 

0 

(k) 

DB  Knob 

18 

Place  the  Scanner  Head 

Assembly  on  the 

center  positioner  in  the  fastener  hole  with  the  fastener 
removed.  (See  figure  2-1  A.) 

NOTE 


Only  one  transducer  can  be  activated  at  a time. 

(4)  Position  the  switch  to  activate  one  of  the  two  transducers. 

(5)  Using  the  radial  adjustment  knob,  position  the  C/L  of  the 
activated  transducer  to  align  with  the  C/L  of  the  fastener 
hole  which  has  the  sawcut.  (See  figure  2-1A.) 


(6)  Adjust  the  tangential  adjustment  knob  until  a back  reflection 
from  the  fastener  hole  appears  on  the  CRT  screen.  (See 
figure  2-1  A. ) 

(7)  Maxim' ue  the  signal  from  the  fastener-  hole  using  both  the  tan- 
gential and  radial  adjustment  knobs. 

(3)  Using  the  sweep  and  delay  controls,  position  the  initial  pulse 
near  the  left  hand  side  of  the  CRT  screen  and  the  back  reflec- 
tion from  the  fastener  hole  near  the  center  of  the  CRT  screen. 
(See  figure  2-1  A.) 

(9)  Rotate  the  transducer  until  the  sound  patn  is  90  degrees  tc 
the  radial  direction  of  the  sawcut.  (See  figure  2-1A.) 

(10)  Using  the  radial  direction  knob  adjust  the  transducer  until  it 
is  aligned  with  the  sawcut. 
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(11)  Using  the  tangential  knob,  move  the  transducer  towards  the 
sawcut  until  an  indication  from  the  sawcut  appears  on  the  CRT 
screen.  (See  figure  2-1 A.) 

(12)  Using  the  tangential  and  radial  direction  knobs,  maximize  the 
back  reflection  from  the  sawcut. 

(13)  With  the  sawcut  back  reflection  maximized,  adjust  the  Reflect- 
oscope  sensitivity  to  give  80  percent  of  scope  saturation  from 
the  sawcut. 


(14)  Loosen  the  lock  and  pull  out  the  internal  panel  containing  the 
gate  controls.  (See  figure  1-13.) 


(15)  Set  the  gate  controls  to  the  following  settings:  (See 
figuure  1-13.) 


(a) 

IF  SYNC 

OFF 

(b) 

AURAL 

ON 

(c) 

GATE 

ON 

(d) 

ALARM  POLARITY 

+ 

(e) 

GATE  LENGTH  CRS 

2 

(f) 

GATE  START  CRS 

2 

(g) 

GATE  LENGTH  FINE 

Set  to  approx.  1/2  inch  in  length 

(h) 

GATE  START  FINE 

Move  the  Gate  to  the  indication  from 
the  sawcut.  (See  figure  2-1 A.) 

0.) 

ALARM  LEVEL 

Set  the  alarm  level  so  that  it  will  be 
activated  when  the  bade  reflection 
from  the  sawcut  reaches  the  50  percent 
level  of  scope  saturation. 

(16)  Rotate  the  transducer  360  degrees  and  note  the  CRT 
presentation  and  gate. 

(17)  The  back  reflection  from  the  sawcut  represents  a defect. 


(18)  To  calibrate  for  the  second  transducer,  position  the  switch  to 
activate  it  and  position  the  transducer  so  that  the  sound  path 
will  hit  the  3awcut  from  the  opposite  direction  of  the  first 
transducer,  (See  figure  2-1A.) 

(15)  Repeat  steps  (5)  through  (16)  for  the  second  transducer. 
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f.  With  the  Scanning  System  properly  calibrated,  apply  couplant  to  ail 
accessible  fastener  holes  in  the  wing  blanks  of  structure  Sample  A 
and  inspect  each  fastener  hole  with  both  transducers. 

g.  Mark  and  report  indicated  defects. 

D.  On  page  2-3,  revise  paragraph  2-6  title  to  read  as  follows: 

2-6.  NDI  PROCEDURE  NO.  3 - EDDY  CURRENT. 

E.  Add  figure  2-1A  immediately  following  figure  2-1. 
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"O"  RING  Pt.  NO.  NASI6II-0I1 
(SUPPLIED  WITH  SLEEVE) 


TRANSDUCER  ASSEMBLY 


NOTE 


'•  ASSEMBLE  WITH  TRANSDUCER  SLEEVE  ANO  BOOT  UNDER  WATER 
USE  DEAERATED  WATER  OR  WATER  THAT  HAS  BEEN  ALLOWED 
TO  STAND  FOR  M HOURS  AT  ROOM  TEMPERATURE,  TO  PREVENT 
AIR  BUBBLES  FROM  FORMING  INSIDE  THE  ASSEMBLY  DURING 
ASSEMBLY,  REMOVE  8UB8LES  FROM  THREADED  END  OF 
TRANSDUCER  ANO  FROM  INSIDE  THE  SLEEVE  AND  BOOT. 

2.  thread  transducer  half  way  into  sleeve. 

3.  SLIP  8COTON  END  OF  SLEEVE  ANO  SEAT  BOOT  RIM  IN  SLEEVE 
GROOVE. 

4.  COMPLETE  THREADING  OF  TRANSDUCER  INTO  SLEEVE  UNTIL  IT 
SEATS  AGAINST  “O”  RING. 


Figure  2-1A.  Setup  and  Calibration  (Sheet  2 of  4) 
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Figure  2-1  A.  Setup  and  Calibration  (Sheet  4 of  4) 
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INSPECTION  PROCEDURES  FOR 
NDI  PROFICIENCY  SCREENING  SAMPLE  PROGRAM 


This  section  contains  nondestructive  inspection  procedures  to  be  performed  on  seventy 
(70)  coupon  samples  during  the  NDI  Reliability  program.  Descriptions  of  the  samples 
and  the  possible  defects  are  given  prior  to  the  (step-by-step)  set-up  and  inspection 
procedures.  The  initial  settings  and  calibrations  for  the  ultrasonic  and  eddy  current 
procedures  are  contained  in  Section  I of  the  Nondestruct?  . 3 Inspection  Reliability 
Program  technical  manual . 

NPi  PROFICIENCY  SCREENING  SAMPLES 

Description  (See  Figure  1).  The  samples  made  of  7075-T6  aluminum  alloy  and  have 
an  exterior  finish  of  one  coat  of  epoxy  primer  and  one  coat  of  polyurethane  enamel . 
Each  sample  has  two  rows  of  5 fastener  holes  in  each  (ten  fastener  holes  total)  con- 
taining loose-fit  countersunk  flush-head  steel  fasteners.  Each  sample  has  an  Identifi- 
cation number  in  the  upper  right  corner  (when  viewed  as  shown  in  Figure  1) . Test 
fixtures  are  provided  for  holding  the  fasteners  in  place  and  facilitating  the  inspection. 

Defects  . All  ten  fastener  holes  in  each  sample  are  to  be  inspected  for  fatigue  cracks 
oriented  width-wise  of  the  specimen. 

NDI  Procedure  No.  1 - Ultrasonic 


a.  NDI  equipment: 

(1)  Reflectoscope,  Sperry  P/N  UM-715  or  equivalent. 

(2)  Transducer,  5.0  MHz  0.250  x 0.250,  60  degree,  aluminum,  shear  wave, 
Sperry  P/N  57A3065  or  equivalent. 

(3)  Cable,  6-foot,  Microdot/UHF  Connector.  Sperry  P/N  57A2270  or 
equivalent. 

i 

(4)  Video  Plug-in  Module,  ION,  Sperry  P/N  50E533  or  equivalent. 

(5)  Couplant,  light  oil. 

(6)  Straightedge  (Ruler). 

(7)  Calibration  Standard,  as  illustrated  in  Figure  2. 

(8)  Test  fixture  as  supplied. 

b.  Access;  The  samples  are  individually  available  for  bench  top  inspection.  The 
accompanying  fixtures  will  not  adversely  affect  access  for  performing  the  inspec- 
tion. 
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c.  Preparation  of  part:  Clean  local  impection  areas  os  needed  to  permit  good 
contact  between  Dart  and  transducer. 

d.  Instrument  settings/calibration:  Calibrate  the  instrument  for  inspection  around 
tire  fastener  holes  as  follows: 

(1)  Position  tire  standard  in  the  ultrasonic  test  fixture  with  a fastener 
in-place  as  shown  in  Figure  2. 

(2)  Apply  couplant  and  couple  60  degree  shear  wave  transducer  to  the 
surface  of  the  calibration  standard  at  hole  2 in  position  B,  os 
illustrated  in  Figure  3,  to  reflect  from  the  bottom  edge  of  the  hole 
wal  I . 

(3)  Rufer  to  paragraph  titled  Ultrasonic  Instrument  Calibration  in  Section 
I of  the  manual  and  calibrate  the  instrument  to  display  the  initial 
pulse  near  tire  left  side  of  the  CRT  display.  Adjust  sweep  to  display 
signal  from  tlx?  fastener  hole  near  the  center  of  the  CRT  display. 

(4)  Place  transducer  in  position  A at  hole  2 and  note  that  the  EDM  slot 
signal  position  is  immediately  to  the  right  of  the  hole  signal  on  the 
CRT  presentation. 

(5)  Maximize  signal  from  the  EDM  slot  by  adjusting  the  transducer  posi- 
tion and  set  the  signal  amplitude  to  obtain  80  percent  saturation  on 
the  CRT  display.  Note  position  of  transducer  when  maximum  signal 
is  returned. 

(61  Scan  positions  A,  B and  C and  observe  the  signals  as  illustrated. 

(7)  Now  place  the  transducer  in  Position  A at  Hole  Oof  the  standard 
and  perform  the  first  scan  using  a straightedge  as  a guide.  In  this 
scan,  the  transducer  is  moved  lengthwise  along  the  surface  of  the 
standard  from  Hole  0 past  Hole  4 so  that  the  transducer  moves  through 
the  A position  for  each  hole.  Note  the  presence  or  absence  of 
return  signals  as  the  transducer  passes  each  hole. 

(8)  The  EDM  slot  signal  simulates  the  signer1  from  a crack  at  the  fastener 
hole . 

e.  Inspection:  Inspect  the  holes  in  the  : ample*  in  a manner  similar  to  step  7 in 
paragraph  d above  (instrument  settings/calibration),  except  that  eight  scans 
are  to  be  made  on  each  sample  as  shown  in  Figure  4.  For  convenience, 
directions  on  the  specimens  are  called  out  as  "forward"  and  "oft",  os  in  air- 
craft wing  spanwise  splice  fastener  patterns. 

(1)  Install  sample  being  inspected  on  the  ultrasonic  test  fixture  with 
all  fasteners  in  place. 
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(2)  Apply  couplant  to  f.'ie  inspection  surface  and  scon  the  transducer  from 
right  to  left  on  the  forward  side  of  each  row  of  fasteners.  Reverse 
the  direction  of  the  transducer  and  scan  from  left  to  right  on  the 
forward  side.  Maintain  couplant  throughout  the  scan. 

NOTE 

The  scans  do  not  have  to  be  continuous  motions  of  the  transducer 
from  one  end  of  the  scan  line  to  the  other  end.  The  inspector 
can  place  the  transducer  in  the  correct  location  at  each  hole  (as 
indicated  in  the  figure)  and  manipulate  the  probe  to  "search" 
for  a flaw  without  using  the  straight  edge. 

(3)  A signal  similar  to  the  one  obtained  during  Step  d(3)  of  instrument  set- 
tings/calibration will  indicate  the  presence  of  a crack.  Be  careful  not 
to  confuse  a reflection  from  the  hole  wall  for  a Ciack  signal. 

NOTE 

If  a small  signal  is  observed  to  "walk"  across  the  baseline  while 
scanning,  place  the  transducer  so  that  the  indication  is  obtained, 
then  adjust  the  transducer  position  and  orientation  until  the  indica- 
tion is  maximized.  If  the  amplitude  increases  considerably,  identify 
the  indication  as  a crcck  signal. 

(4)  Repeat  Steps  e(2)  and  e(3)  for  inspection  of  the  aft  side  of  the  fastener 
holes. 

(5)  Inspect  ten  holes  in  each  specimen. 

f.  Mark  and  report  indicated  defects. 

NDI  Procedure  No.  2 - Fddy  Current 

a.  NDI  equipment: 

(1)  Crack  Detector,  Magnaflux  P/N  ED-520  or  equivalent. 

(2)  Probe  Bolt  Hole,  3/16  to  1/4  inch  diameter.  Ideal  specialties 
P/N  1600-3/16  to  1/4-BH  or  equivalent. 

(3)  Calibration  Standard,  aluminum  (see  Figure  2). 

(4)  Test  Fixture  os  supplied. 
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b.  Preparation  of  part:  Same  as  for  NDI  Procedure  No.  1,  except  that  the 
fasteners  are  to  be  removed  from  all  holes  prior  to  inspection. 

c.  Access:  Same  as  for  NDI  Procedure  No.  1. 

d.  Instrument  settings/calibration:  Refer  to  paragraph  titled  Eddy  Current 
Instrument  Calibration  and  Bolt  Hole  Inspection  technique  in  Section  1 
of  the  manual  and  use  the  aluminum  standard  supplied. 

e.  Inspection: 

(1)  Scan  the  entire  inner  surface  of  each  hole  at  two  depths  in  a manner 
prescribed  in  step  d above  and  as  depicted  in  Figure  5.  Install  the 
specimen  being  inspected  on  the  eddy  current  test  fixture  to  facilitate 
the  inspection. 

(2)  A sharp  meter  deflection  as  noted  during  calibration  will  indicate 
a probable  crack. 

f.  Mark  and  report  all  indicated  defects. 
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FIGURE  4.  POSITIONING  OF  PPOSE  AND  METHOD  OF  SCANNING  FOP 
UlT  PASO  NIC  NDI 


SAMPLE  ID  NO. 


